[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:30 dist-test-slave-4tdj krb5kdc[19583](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:30 dist-test-slave-4tdj krb5kdc[19583](info): set up 2 sockets
Aug 10 14:48:30 dist-test-slave-4tdj krb5kdc[19583](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260810 14:48:31.354187 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.192s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:31 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:31.468870 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45175
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45175
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:31.587098 19603 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:31.587292 19603 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:31.587323 19603 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:31.588479 19603 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:31.588522 19603 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:31.588541 19603 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:31.588557 19603 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:31.588574 19603 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:31.590478 19603 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45175
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45175
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19603
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:31.590857 19603 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:31.591092 19603 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:31.598737 19616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:31.598726 19611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:31.598722 19603 server_base.cc:1034] running on GCE node
W20260810 14:48:31.598816 19612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:31.599251 19603 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:31.599625 19603 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:31.600772 19603 hybrid_clock.cc:648] HybridClock initialized: now 1786373311600752 us; error 32 us; skew 500 ppm
Aug 10 14:48:31 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373311, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:31.603722 19603 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:31.604369 19603 webserver.cc:460] Webserver started at http://127.19.29.254:37519/ using document root <none> and password file <none>
I20260810 14:48:31.604641 19603 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:31.604696 19603 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:31.604871 19603 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:31.606094 19603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "099b8d641f324dae9b9e7e8418b8fa2d"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "3b5af1a3127d028cfcfc08ff952349d1"
server_key_iv: "a259e8c9787d2c864b5b60c8142d3f98"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.606451 19603 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "099b8d641f324dae9b9e7e8418b8fa2d"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "3b5af1a3127d028cfcfc08ff952349d1"
server_key_iv: "a259e8c9787d2c864b5b60c8142d3f98"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.608222 19603 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s
I20260810 14:48:31.609247 19630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:31.609474 19603 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:48:31.609565 19603 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "099b8d641f324dae9b9e7e8418b8fa2d"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "3b5af1a3127d028cfcfc08ff952349d1"
server_key_iv: "a259e8c9787d2c864b5b60c8142d3f98"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.609624 19603 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:31.619393 19603 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:31.621445 19603 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:31.621662 19603 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:31.633713 19603 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45175
I20260810 14:48:31.633780 19721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45175 every 8 connection(s)
I20260810 14:48:31.634407 19603 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:31.635845 19722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:31.638948 19722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d: Bootstrap starting.
I20260810 14:48:31.639863 19722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:31.640213 19722 log.cc:824] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:31.641148 19722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d: No bootstrap required, opened a new log
I20260810 14:48:31.642993 19722 raft_consensus.cc:348] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } }
I20260810 14:48:31.643158 19722 raft_consensus.cc:374] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:31.643231 19722 raft_consensus.cc:729] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 099b8d641f324dae9b9e7e8418b8fa2d, State: Initialized, Role: FOLLOWER
I20260810 14:48:31.643430 19722 consensus_queue.cc:260] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } }
I20260810 14:48:31.643641 19722 raft_consensus.cc:388] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:31.643690 19722 raft_consensus.cc:482] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:31.643747 19722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:31.643807 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19603
I20260810 14:48:31.643910 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:31.644717 19722 raft_consensus.cc:504] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } }
I20260810 14:48:31.644832 19575 external_mini_cluster.cc:1428] Setting key 1170db89385728a6d6d622d5bf0963fb
I20260810 14:48:31.644935 19722 leader_election.cc:302] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 099b8d641f324dae9b9e7e8418b8fa2d; no voters:
I20260810 14:48:31.645195 19722 leader_election.cc:288] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:31.645246 19725 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:31.645403 19725 raft_consensus.cc:686] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [term 1 LEADER]: Becoming Leader. State: Replica: 099b8d641f324dae9b9e7e8418b8fa2d, State: Running, Role: LEADER
I20260810 14:48:31.645547 19725 consensus_queue.cc:237] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } }
I20260810 14:48:31.645699 19722 sys_catalog.cc:564] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:31.646174 19726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } } }
I20260810 14:48:31.646879 19726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:31.646385 19727 sys_catalog.cc:455] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 099b8d641f324dae9b9e7e8418b8fa2d. Latest consensus state: current_term: 1 leader_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "099b8d641f324dae9b9e7e8418b8fa2d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45175 } } }
I20260810 14:48:31.647109 19727 sys_catalog.cc:458] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:31.647382 19736 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:31.649412 19736 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:31.652336 19736 catalog_manager.cc:1347] Generated new cluster ID: e7a5c1a0c1f548c586a5813d453ac9c0
I20260810 14:48:31.652397 19736 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:48:31 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373311, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:31.665077 19736 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:31.665778 19736 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:31.668735 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:31.646453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40950 (local address 127.19.29.254:45175)
0810 14:48:31.646771 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:31.646780 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:31.648956 (+ 2176us) server_negotiation.cc:407] Connection header received
0810 14:48:31.651215 (+ 2259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:31.651220 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:31.651308 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:31.651431 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:31.654323 (+ 2892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.656207 (+ 1884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.657699 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.658646 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.658762 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:31.663729 (+ 4967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:31.663733 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:31.663734 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:31.663746 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:31.666466 (+ 2720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:31.666994 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:31.666997 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:31.666998 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:31.667102 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:31.667398 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:31.667398 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:31.667399 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:31.667654 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:31.667900 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:31.668128 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 14:48:31.668322 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":131,"threads_started":1}
I20260810 14:48:31.671268 19736 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 099b8d641f324dae9b9e7e8418b8fa2d: Generated new TSK 0
I20260810 14:48:31.671430 19736 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:31.698675 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:31.790177 19766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:31.790401 19766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:31.790436 19766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:31.791545 19766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:31.791584 19766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:31.791618 19766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:31.793047 19766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:31.793332 19766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:31.793565 19766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:31.800115 19775 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:31.800257 19777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:31.800103 19774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:31.800387 19766 server_base.cc:1034] running on GCE node
I20260810 14:48:31.800719 19766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:31.801007 19766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:31.802196 19766 hybrid_clock.cc:648] HybridClock initialized: now 1786373311802176 us; error 34 us; skew 500 ppm
Aug 10 14:48:31 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373311, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:31.805296 19766 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:31.805728 19766 webserver.cc:460] Webserver started at http://127.19.29.193:39449/ using document root <none> and password file <none>
I20260810 14:48:31.805922 19766 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:31.805985 19766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:31.806118 19766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:31.807165 19766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "0f537fad77f14fce959c6403d7c3cb77"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "6d1c77b812b9e46bae0fdb6f1f9963c6"
server_key_iv: "598fea59c82fad3f0c34d6e744947385"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.807518 19766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "0f537fad77f14fce959c6403d7c3cb77"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "6d1c77b812b9e46bae0fdb6f1f9963c6"
server_key_iv: "598fea59c82fad3f0c34d6e744947385"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.808842 19766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:31.809618 19787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:31.809787 19766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:31.809886 19766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "0f537fad77f14fce959c6403d7c3cb77"
format_stamp: "Formatted at 2026-08-10 14:48:31 on dist-test-slave-4tdj"
server_key: "6d1c77b812b9e46bae0fdb6f1f9963c6"
server_key_iv: "598fea59c82fad3f0c34d6e744947385"
server_key_version: "encryptionkey@0"
I20260810 14:48:31.809950 19766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:31.833248 19766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:31.835443 19766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:31.835606 19766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:31.835883 19766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:31.836282 19766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:31.836374 19766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:31.836414 19766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:31.836439 19766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:31.844983 19766 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:38321
I20260810 14:48:31.845026 19975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:38321 every 8 connection(s)
I20260810 14:48:31.845367 19766 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:31 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373311, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:31.853833 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19766
I20260810 14:48:31.853915 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:31.854054 19575 external_mini_cluster.cc:1428] Setting key 47365d923893ce418425f14535b349ec
I20260810 14:48:31.854120 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:31.846180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:52851 (local address 127.19.29.254:45175)
0810 14:48:31.846225 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:31.846227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:31.846501 (+ 274us) server_negotiation.cc:407] Connection header received
0810 14:48:31.847004 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:31.847006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:31.847019 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:31.847071 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:31.848140 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.848624 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.849606 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.849794 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.849848 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:31.851821 (+ 1973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:31.851822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:31.851823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:31.851830 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:31.852909 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:31.853276 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:31.853277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:31.853277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:31.853329 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:31.853542 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:31.853543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:31.853543 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:31.853645 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:31.853703 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:31.853949 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 14:48:31.854034 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:48:31.854354 19981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:31.846176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45175 (local address 127.19.29.193:52851)
0810 14:48:31.846380 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:31.846417 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:31.846905 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:31.847141 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:31.847145 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:31.847836 (+ 691us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:31.848037 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:31.848042 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.848710 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.848711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:31.849515 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:31.849518 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:31.849863 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:31.849864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:31.849992 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:31.850427 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:31.850435 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:31.851733 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:31.852984 (+ 1251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:31.852992 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:31.852994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:31.853208 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:31.853384 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:31.853385 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:31.853386 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:31.853481 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:31.853702 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:31.853709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:31.853834 (+ 125us) client_negotiation.cc:769] Sending connection context
0810 14:48:31.853917 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:48:31.854075 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":87,"threads_started":1}
I20260810 14:48:31.854805 19979 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45175
I20260810 14:48:31.854898 19979 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:31.855067 19979 heartbeater.cc:511] Master 127.19.29.254:45175 requested a full tablet report, sending...
I20260810 14:48:31.855856 19653 ts_manager.cc:194] Registered new tserver with Master: 0f537fad77f14fce959c6403d7c3cb77 (127.19.29.193:38321)
I20260810 14:48:31.856837 19653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:52851
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:31.877892 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:31.997911 19984 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:31.998106 19984 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:31.998131 19984 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:31.999353 19984 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:31.999395 19984 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:31.999423 19984 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:32.001029 19984 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19984
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:32.001217 19984 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:32.001386 19984 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:32.007738 19995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:32.007838 19998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:32.007930 19994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:32.007988 19984 server_base.cc:1034] running on GCE node
I20260810 14:48:32.008190 19984 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:32.008412 19984 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:32.009546 19984 hybrid_clock.cc:648] HybridClock initialized: now 1786373312009532 us; error 32 us; skew 500 ppm
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:32.012480 19984 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:32.012925 19984 webserver.cc:460] Webserver started at http://127.19.29.194:43139/ using document root <none> and password file <none>
I20260810 14:48:32.013111 19984 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:32.013151 19984 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:32.013238 19984 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:32.014524 19984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "449be64baf4443be9842f4086dc07028"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "1f5d2716ef127d5983c0880400b1a8d0"
server_key_iv: "472ead09feb078e7adb36d7060fe3b76"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.014890 19984 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "449be64baf4443be9842f4086dc07028"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "1f5d2716ef127d5983c0880400b1a8d0"
server_key_iv: "472ead09feb078e7adb36d7060fe3b76"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.016228 19984 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:48:32.017176 20006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.017340 19984 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:48:32.017428 19984 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "449be64baf4443be9842f4086dc07028"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "1f5d2716ef127d5983c0880400b1a8d0"
server_key_iv: "472ead09feb078e7adb36d7060fe3b76"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.017504 19984 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:32.032617 19984 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:32.034622 19984 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:32.034732 19984 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:32.034911 19984 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:32.035200 19984 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:32.035235 19984 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.035256 19984 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:32.035279 19984 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.048647 19984 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:39093
I20260810 14:48:32.048705 20187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:39093 every 8 connection(s)
I20260810 14:48:32.049028 19984 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:32.053097 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19984
I20260810 14:48:32.053184 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:32.053341 19575 external_mini_cluster.cc:1428] Setting key 35770d3cc5385773a9eaa22e2a9b82fa
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:32.058650 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.049749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:60233 (local address 127.19.29.254:45175)
0810 14:48:32.049792 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:32.049794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:32.050082 (+ 288us) server_negotiation.cc:407] Connection header received
0810 14:48:32.050674 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:32.050675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:32.050686 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:32.050733 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:32.051653 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.052138 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.053138 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.053416 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.053485 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.055884 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:32.055885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:32.055886 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:32.055894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:32.057306 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.057683 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.057684 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.057685 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.057749 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.057944 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.057945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.057945 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.058070 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:32.058135 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:32.058455 (+ 320us) server_negotiation.cc:299] Negotiation successful
0810 14:48:32.058565 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:48:32.058741 20193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.049702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45175 (local address 127.19.29.194:60233)
0810 14:48:32.049940 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:32.049976 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:32.050589 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:32.050786 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:32.050789 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:32.051366 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:32.051587 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:32.051592 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.052201 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.052201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:32.053057 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:32.053060 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.053496 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.053497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:32.053641 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.054125 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:32.054135 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:32.055780 (+ 1645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:32.057389 (+ 1609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:32.057396 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:32.057398 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:32.057612 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:32.057808 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:32.057809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:32.057809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:32.057895 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:32.058157 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:32.058164 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:32.058282 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 14:48:32.058410 (+ 128us) client_negotiation.cc:240] Negotiation successful
0810 14:48:32.058540 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":114,"threads_started":1}
I20260810 14:48:32.059305 20189 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45175
I20260810 14:48:32.059392 20189 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:32.059559 20189 heartbeater.cc:511] Master 127.19.29.254:45175 requested a full tablet report, sending...
I20260810 14:48:32.059922 19653 ts_manager.cc:194] Registered new tserver with Master: 449be64baf4443be9842f4086dc07028 (127.19.29.194:39093)
I20260810 14:48:32.060288 19653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:60233
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:32.079136 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:32.169334 20197 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:32.169552 20197 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:32.169587 20197 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:32.170778 20197 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:32.170825 20197 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:32.170863 20197 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:32.172706 20197 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45175
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20197
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:32.172950 20197 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:32.173197 20197 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:32.178575 20205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:32.178659 20206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:32.178629 20211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:32.178936 20197 server_base.cc:1034] running on GCE node
I20260810 14:48:32.179121 20197 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:32.179350 20197 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:32.180560 20197 hybrid_clock.cc:648] HybridClock initialized: now 1786373312180546 us; error 26 us; skew 500 ppm
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:32.183076 20197 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:32.183496 20197 webserver.cc:460] Webserver started at http://127.19.29.195:35055/ using document root <none> and password file <none>
I20260810 14:48:32.183728 20197 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:32.183776 20197 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:32.183902 20197 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:32.185146 20197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "525aa2661a8941b4bc5c3044e290bc11"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "270599e2e64ba09aafd960106fa76972"
server_key_iv: "d24df974270efe059f7978f25d966c37"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.185556 20197 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "525aa2661a8941b4bc5c3044e290bc11"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "270599e2e64ba09aafd960106fa76972"
server_key_iv: "d24df974270efe059f7978f25d966c37"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.187150 20197 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 14:48:32.187845 20222 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.187985 20197 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:32.188083 20197 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "525aa2661a8941b4bc5c3044e290bc11"
format_stamp: "Formatted at 2026-08-10 14:48:32 on dist-test-slave-4tdj"
server_key: "270599e2e64ba09aafd960106fa76972"
server_key_iv: "d24df974270efe059f7978f25d966c37"
server_key_version: "encryptionkey@0"
I20260810 14:48:32.188140 20197 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:32.211220 20197 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:32.213562 20197 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:32.213758 20197 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:32.213977 20197 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:32.214311 20197 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:32.214354 20197 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.214376 20197 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:32.214401 20197 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:32.225840 20197 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:39853
I20260810 14:48:32.226032 20396 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:39853 every 8 connection(s)
I20260810 14:48:32.226183 20197 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:32.233958 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20197
I20260810 14:48:32.234042 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:32.234184 19575 external_mini_cluster.cc:1428] Setting key 0d2fb3c8cc618ab085f34a3a458d4358
I20260810 14:48:32.235961 19729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.226942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:33567 (local address 127.19.29.254:45175)
0810 14:48:32.227031 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:32.227034 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:32.227275 (+ 241us) server_negotiation.cc:407] Connection header received
0810 14:48:32.228015 (+ 740us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:32.228016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:32.228036 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:32.228086 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:32.229180 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.229667 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.230820 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.231034 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.231090 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.233295 (+ 2205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:32.233297 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:32.233297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:32.233304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:32.234588 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.235004 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.235005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.235005 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.235067 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.235325 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.235325 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.235325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.235434 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:32.235493 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:32.235790 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 14:48:32.235875 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:48:32.236131 20403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.226918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45175 (local address 127.19.29.195:33567)
0810 14:48:32.227139 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:32.227176 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:32.227930 (+ 754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:32.228141 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:32.228144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:32.228796 (+ 652us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:32.229108 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:32.229114 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.229733 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.229734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:32.230734 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:32.230737 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.231116 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.231117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:32.231220 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.231683 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:32.231691 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:32.233213 (+ 1522us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:32.234663 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:32.234670 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:32.234672 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:32.234938 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:32.235130 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:32.235131 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:32.235131 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:32.235264 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:32.235500 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:32.235508 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:32.235662 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 14:48:32.235753 (+ 91us) client_negotiation.cc:240] Negotiation successful
0810 14:48:32.235906 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":108,"threads_started":1}
I20260810 14:48:32.236572 20397 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45175
I20260810 14:48:32.236667 20397 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:32.236835 20397 heartbeater.cc:511] Master 127.19.29.254:45175 requested a full tablet report, sending...
I20260810 14:48:32.237159 19653 ts_manager.cc:194] Registered new tserver with Master: 525aa2661a8941b4bc5c3044e290bc11 (127.19.29.195:39853)
I20260810 14:48:32.237517 19653 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:33567
I20260810 14:48:32.246332 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:32.270514 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.263143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38446 (local address 127.19.29.193:38321)
0810 14:48:32.263291 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:32.263296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:32.263306 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:32.263333 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:32.263334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:32.263348 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:32.263412 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:32.264013 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.264733 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.265427 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.265752 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.265802 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.268015 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:32.268024 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:32.268025 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:32.268031 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:32.269498 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.269810 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.269813 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.269814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.269877 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.270007 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.270008 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.270008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.270156 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:32.270274 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:32.270331 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 14:48:32.270404 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
W20260810 14:48:32.271047 19835 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38446
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[19583](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:32.292665 20415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:32.286269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38456 (local address 127.19.29.193:38321)
0810 14:48:32.286384 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:32.286386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:32.286395 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:32.286449 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:32.286450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:32.286459 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:32.286513 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:32.287083 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.287592 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.288303 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:32.288520 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:32.288571 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:32.290588 (+ 2017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:32.290589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:32.290589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:32.290596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:32.291805 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.292093 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.292094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.292094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.292144 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:32.292270 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:32.292270 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:32.292271 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:32.292354 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:32.292437 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:32.292490 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 14:48:32.292577 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:48:32.293171 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19766
I20260810 14:48:32.315584 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19984
I20260810 14:48:32.341957 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20197
I20260810 14:48:32.353950 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19603
2026-08-10T14:48:32Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2223 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[20424](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[20424](info): set up 2 sockets
Aug 10 14:48:32 dist-test-slave-4tdj krb5kdc[20424](info): commencing operation
krb5kdc: starting...
W20260810 14:48:33.523289 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:33 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:33.636338 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38987
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:38987
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:33.717976 20448 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:33.718179 20448 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:33.718202 20448 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:33.719306 20448 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:33.719347 20448 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:33.719362 20448 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:33.719374 20448 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:33.719386 20448 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:33.720914 20448 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:38987
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38987
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20448
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:33.721127 20448 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:33.721304 20448 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:33.726039 20455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:33.726037 20456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:33.726125 20461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:33.726248 20448 server_base.cc:1034] running on GCE node
I20260810 14:48:33.726503 20448 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:33.726795 20448 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:33.727932 20448 hybrid_clock.cc:648] HybridClock initialized: now 1786373313727915 us; error 35 us; skew 500 ppm
Aug 10 14:48:33 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:33.730399 20448 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:33.730790 20448 webserver.cc:460] Webserver started at http://127.19.29.254:37165/ using document root <none> and password file <none>
I20260810 14:48:33.730985 20448 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:33.731024 20448 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:33.731110 20448 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:33.732095 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "e18bcba69ea4420daa83f026473dfc0c"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "c99f0ce4af387255fa29e80e829dda61"
server_key_iv: "46df9f62dd5ecb3831c773ebaccd9d44"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.732400 20448 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "e18bcba69ea4420daa83f026473dfc0c"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "c99f0ce4af387255fa29e80e829dda61"
server_key_iv: "46df9f62dd5ecb3831c773ebaccd9d44"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.733587 20448 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:33.734270 20471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:33.734491 20448 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:33.734586 20448 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "e18bcba69ea4420daa83f026473dfc0c"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "c99f0ce4af387255fa29e80e829dda61"
server_key_iv: "46df9f62dd5ecb3831c773ebaccd9d44"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.734643 20448 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:33.749441 20448 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:33.751119 20448 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:33.751222 20448 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:33.754885 20448 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:38987
I20260810 14:48:33.754920 20549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:38987 every 8 connection(s)
I20260810 14:48:33.755205 20448 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:33.756007 20551 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:33.758419 20551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c: Bootstrap starting.
I20260810 14:48:33.758970 20551 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:33.759217 20551 log.cc:824] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:33.759859 20551 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c: No bootstrap required, opened a new log
I20260810 14:48:33.760604 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20448
I20260810 14:48:33.760691 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:33.760847 19575 external_mini_cluster.cc:1428] Setting key e3b526ce8512587fd003c224a8b7f04b
I20260810 14:48:33.761822 20551 raft_consensus.cc:348] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } }
I20260810 14:48:33.761970 20551 raft_consensus.cc:374] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:33.762008 20551 raft_consensus.cc:729] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e18bcba69ea4420daa83f026473dfc0c, State: Initialized, Role: FOLLOWER
I20260810 14:48:33.762135 20551 consensus_queue.cc:260] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } }
I20260810 14:48:33.762213 20551 raft_consensus.cc:388] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:33.762251 20551 raft_consensus.cc:482] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:33.762336 20551 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:33.763494 20551 raft_consensus.cc:504] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } }
I20260810 14:48:33.763597 20551 leader_election.cc:302] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e18bcba69ea4420daa83f026473dfc0c; no voters:
I20260810 14:48:33.763782 20551 leader_election.cc:288] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:33.763803 20562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:33.763918 20562 raft_consensus.cc:686] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [term 1 LEADER]: Becoming Leader. State: Replica: e18bcba69ea4420daa83f026473dfc0c, State: Running, Role: LEADER
I20260810 14:48:33.764000 20562 consensus_queue.cc:237] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } }
I20260810 14:48:33.764052 20551 sys_catalog.cc:564] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:33.764324 20562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e18bcba69ea4420daa83f026473dfc0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } } }
I20260810 14:48:33.764396 20562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:33.764567 20562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [sys.catalog]: SysCatalogTable state changed. Reason: New leader e18bcba69ea4420daa83f026473dfc0c. Latest consensus state: current_term: 1 leader_uuid: "e18bcba69ea4420daa83f026473dfc0c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e18bcba69ea4420daa83f026473dfc0c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38987 } } }
I20260810 14:48:33.764627 20562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:33.765183 20570 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:33.766057 20570 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 14:48:33 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:33.767695 20570 catalog_manager.cc:1347] Generated new cluster ID: 2046fb802c2443d7b0e3f2153eb81438
I20260810 14:48:33.767745 20570 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:33.771317 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:33.761350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.19.29.254:38987)
0810 14:48:33.761518 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:33.761525 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:33.761549 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:48:33.761791 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:33.761796 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:33.761838 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:33.761941 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:33.762699 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.763558 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.764562 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.765103 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.765223 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:33.767953 (+ 2730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:33.767957 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:33.767957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:33.767967 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:33.769742 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:33.770123 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:33.770125 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:33.770126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:33.770241 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:33.770460 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:33.770460 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:33.770461 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:33.770731 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:33.770881 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:33.770985 (+ 104us) server_negotiation.cc:299] Negotiation successful
0810 14:48:33.771116 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260810 14:48:33.775238 20570 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:33.775908 20570 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:33.779608 20570 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e18bcba69ea4420daa83f026473dfc0c: Generated new TSK 0
I20260810 14:48:33.779764 20570 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:33.806789 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:33.887434 20599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:33.887629 20599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:33.887661 20599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:33.888756 20599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:33.888794 20599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:33.888827 20599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:33.890264 20599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:33.890519 20599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:33.890717 20599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:33.895573 20606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:33.895543 20609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:33.895584 20599 server_base.cc:1034] running on GCE node
W20260810 14:48:33.895548 20607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:33.895951 20599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:33.896174 20599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:33.897315 20599 hybrid_clock.cc:648] HybridClock initialized: now 1786373313897294 us; error 32 us; skew 500 ppm
Aug 10 14:48:33 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:33.899788 20599 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:33.900188 20599 webserver.cc:460] Webserver started at http://127.19.29.193:39505/ using document root <none> and password file <none>
I20260810 14:48:33.900374 20599 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:33.900424 20599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:33.900555 20599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:33.901551 20599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "c00a69b5536a4fb0b088cfefcf491170"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "e38919ea355db8564bd91247a0a3e09a"
server_key_iv: "f558f0d4a013dff8652a5cb19a619127"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.901872 20599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "c00a69b5536a4fb0b088cfefcf491170"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "e38919ea355db8564bd91247a0a3e09a"
server_key_iv: "f558f0d4a013dff8652a5cb19a619127"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.903182 20599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260810 14:48:33.903877 20617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:33.904031 20599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:33.904115 20599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "c00a69b5536a4fb0b088cfefcf491170"
format_stamp: "Formatted at 2026-08-10 14:48:33 on dist-test-slave-4tdj"
server_key: "e38919ea355db8564bd91247a0a3e09a"
server_key_iv: "f558f0d4a013dff8652a5cb19a619127"
server_key_version: "encryptionkey@0"
I20260810 14:48:33.904173 20599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:33.925539 20599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:33.927251 20599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:33.927381 20599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:33.927618 20599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:33.927898 20599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:33.927930 20599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:33.927958 20599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:33.927980 20599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:33.933395 20599 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:42345
I20260810 14:48:33.933471 20804 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:42345 every 8 connection(s)
I20260810 14:48:33.933738 20599 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:33 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:33.941711 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20599
I20260810 14:48:33.941787 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:33.941911 19575 external_mini_cluster.cc:1428] Setting key c9a333c01f77927c61f3386d8a89cab0
I20260810 14:48:33.943008 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:33.934409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:36911 (local address 127.19.29.254:38987)
0810 14:48:33.934459 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:33.934461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:33.934685 (+ 224us) server_negotiation.cc:407] Connection header received
0810 14:48:33.935674 (+ 989us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:33.935675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:33.935690 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:33.935741 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:33.936276 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.936779 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.937832 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.938046 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.938106 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:33.940000 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:33.940001 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:33.940002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:33.940009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:33.941248 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:33.942047 (+ 799us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:33.942048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:33.942048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:33.942096 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:33.942361 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:33.942362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:33.942363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:33.942479 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:33.942547 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:33.942812 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 14:48:33.942914 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:48:33.943019 20818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:33.934410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38987 (local address 127.19.29.193:36911)
0810 14:48:33.934575 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:33.934609 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:33.935578 (+ 969us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:33.935793 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:33.935796 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:33.936025 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:33.936200 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:33.936203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.936864 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.936865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:33.937744 (+ 879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:33.937747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:33.938114 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:33.938114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:33.938230 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:33.938669 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:33.938677 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:33.939919 (+ 1242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:33.941326 (+ 1407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:33.941333 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:33.941335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:33.941541 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:33.942154 (+ 613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:33.942155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:33.942155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:33.942273 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:33.942546 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:33.942553 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:33.942664 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 14:48:33.942742 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:48:33.942867 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260810 14:48:33.943490 20811 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38987
I20260810 14:48:33.943605 20811 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:33.943766 20811 heartbeater.cc:511] Master 127.19.29.254:38987 requested a full tablet report, sending...
I20260810 14:48:33.944283 20503 ts_manager.cc:194] Registered new tserver with Master: c00a69b5536a4fb0b088cfefcf491170 (127.19.29.193:42345)
I20260810 14:48:33.944869 20503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:36911
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:33.964942 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:34.044533 20823 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:34.044715 20823 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:34.044746 20823 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:34.045881 20823 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:34.045920 20823 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:34.045954 20823 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:34.047433 20823 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20823
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:34.047668 20823 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:34.047863 20823 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:34.052704 20835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:34.052707 20832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:34.052683 20833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:34.052736 20823 server_base.cc:1034] running on GCE node
I20260810 14:48:34.053097 20823 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:34.053315 20823 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:34.054454 20823 hybrid_clock.cc:648] HybridClock initialized: now 1786373314054441 us; error 32 us; skew 500 ppm
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:34.056816 20823 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:34.057225 20823 webserver.cc:460] Webserver started at http://127.19.29.194:46467/ using document root <none> and password file <none>
I20260810 14:48:34.057446 20823 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:34.057494 20823 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:34.057617 20823 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:34.058656 20823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "c72c501d69c1472cba888ec01460659e"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "08160c833bc295d56d9d54b2a315c64e"
server_key_iv: "f18ae745f95dfa65df16e04547e543f3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.059007 20823 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "c72c501d69c1472cba888ec01460659e"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "08160c833bc295d56d9d54b2a315c64e"
server_key_iv: "f18ae745f95dfa65df16e04547e543f3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.060243 20823 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:34.060849 20843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.060997 20823 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:34.061100 20823 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "c72c501d69c1472cba888ec01460659e"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "08160c833bc295d56d9d54b2a315c64e"
server_key_iv: "f18ae745f95dfa65df16e04547e543f3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.061160 20823 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:34.083304 20823 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:34.085012 20823 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:34.085157 20823 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:34.085386 20823 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:34.085692 20823 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:34.085727 20823 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.085757 20823 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:34.085774 20823 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.091392 20823 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:40699
I20260810 14:48:34.091457 21013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:40699 every 8 connection(s)
I20260810 14:48:34.091739 20823 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:34.099489 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20823
I20260810 14:48:34.099560 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:34.099722 19575 external_mini_cluster.cc:1428] Setting key 223c26a911e8bfff47b77e98893fec64
I20260810 14:48:34.100313 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.092558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:35323 (local address 127.19.29.254:38987)
0810 14:48:34.092624 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.092626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.092809 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:48:34.093673 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.093674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.093684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.093735 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.094262 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.094776 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.095692 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.095871 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.095911 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.097822 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.097824 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.097824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.097833 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.098990 (+ 1157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.099348 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.099349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.099349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.099413 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.099646 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.099647 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.099648 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.099760 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.099820 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.100138 (+ 318us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.100222 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:48:34.100447 21017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.092521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38987 (local address 127.19.29.194:35323)
0810 14:48:34.092682 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.092731 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.093594 (+ 863us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.093788 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.093791 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.094020 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:34.094199 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.094204 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.094838 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.094839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.095624 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.095627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.095920 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.095921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.096012 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.096389 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:34.096397 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:34.097723 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:34.099063 (+ 1340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:34.099071 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:34.099073 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:34.099278 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:34.099468 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:34.099468 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:34.099469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:34.099595 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:34.099824 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:34.099832 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:34.099984 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.100074 (+ 90us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.100225 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260810 14:48:34.100878 21015 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38987
I20260810 14:48:34.100973 21015 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:34.101137 21015 heartbeater.cc:511] Master 127.19.29.254:38987 requested a full tablet report, sending...
I20260810 14:48:34.101504 20503 ts_manager.cc:194] Registered new tserver with Master: c72c501d69c1472cba888ec01460659e (127.19.29.194:40699)
I20260810 14:48:34.101861 20503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:35323
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:34.124714 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:42569
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:34.207369 21024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:34.207585 21024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:34.207609 21024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:34.208794 21024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:34.208840 21024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:34.208876 21024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:34.210383 21024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42569
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38987
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:34.210618 21024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:34.210829 21024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:34.215687 21036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:34.215701 21031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:34.215696 21030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:34.215883 21024 server_base.cc:1034] running on GCE node
I20260810 14:48:34.216076 21024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:34.216279 21024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:34.217422 21024 hybrid_clock.cc:648] HybridClock initialized: now 1786373314217410 us; error 29 us; skew 500 ppm
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:34.219856 21024 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:34.220300 21024 webserver.cc:460] Webserver started at http://127.19.29.195:44575/ using document root <none> and password file <none>
I20260810 14:48:34.220492 21024 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:34.220538 21024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:34.220671 21024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:34.221752 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "0d962ef8dd214c12a20355d03f31f087"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "f128c2de12758fcd0a3eac9bf55b5f39"
server_key_iv: "45526aeb6deb2cc6cef0414b04c9ddf3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.222079 21024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "0d962ef8dd214c12a20355d03f31f087"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "f128c2de12758fcd0a3eac9bf55b5f39"
server_key_iv: "45526aeb6deb2cc6cef0414b04c9ddf3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.223357 21024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:34.224049 21048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.224217 21024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:34.224303 21024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "0d962ef8dd214c12a20355d03f31f087"
format_stamp: "Formatted at 2026-08-10 14:48:34 on dist-test-slave-4tdj"
server_key: "f128c2de12758fcd0a3eac9bf55b5f39"
server_key_iv: "45526aeb6deb2cc6cef0414b04c9ddf3"
server_key_version: "encryptionkey@0"
I20260810 14:48:34.224361 21024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:34.243134 21024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:34.245231 21024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:34.245371 21024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:34.245608 21024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:34.245898 21024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:34.245931 21024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.245960 21024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:34.245981 21024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:34.251653 21024 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45995
I20260810 14:48:34.251693 21225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45995 every 8 connection(s)
I20260810 14:48:34.251994 21024 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:34.259611 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21024
I20260810 14:48:34.259706 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:34.259894 19575 external_mini_cluster.cc:1428] Setting key db02e8f4385fa5e7201486b1df717513
I20260810 14:48:34.261137 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.252738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:58689 (local address 127.19.29.254:38987)
0810 14:48:34.252827 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.252830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.252976 (+ 146us) server_negotiation.cc:407] Connection header received
0810 14:48:34.253931 (+ 955us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.253933 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.253946 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.253998 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.254704 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.255212 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.256194 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.256390 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.256446 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.258518 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.258520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.258520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.258529 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.259609 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.260141 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.260142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.260142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.260202 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.260518 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.260519 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.260519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.260657 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.260726 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.260992 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.261072 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260810 14:48:34.261281 21232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.252658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38987 (local address 127.19.29.195:58689)
0810 14:48:34.252841 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.252890 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.253816 (+ 926us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.254071 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.254075 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.254381 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:34.254609 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.254615 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.255298 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.255299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.256106 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.256108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.256461 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.256462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.256595 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.257030 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:34.257039 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:34.258432 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:34.259760 (+ 1328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:34.259769 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:34.259771 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:34.260056 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:34.260266 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:34.260267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:34.260268 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:34.260415 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:34.260722 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:34.260727 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:34.260876 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.260960 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.261086 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":80,"threads_started":1}
I20260810 14:48:34.261682 21230 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38987
I20260810 14:48:34.261775 21230 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:34.261946 21230 heartbeater.cc:511] Master 127.19.29.254:38987 requested a full tablet report, sending...
I20260810 14:48:34.262359 20503 ts_manager.cc:194] Registered new tserver with Master: 0d962ef8dd214c12a20355d03f31f087 (127.19.29.195:45995)
I20260810 14:48:34.262723 20503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:58689
I20260810 14:48:34.271714 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:48:34.278805 20561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.273646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38024 (local address 127.19.29.254:38987)
0810 14:48:34.273707 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.273709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.273752 (+ 43us) server_negotiation.cc:407] Connection header received
0810 14:48:34.273794 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.273795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.273803 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.273849 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.274394 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.274875 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.275526 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.275728 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.275773 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.276811 (+ 1038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.276812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.276813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.276818 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.277851 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.278135 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.278136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.278136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.278179 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.278331 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.278332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.278332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.278469 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.278564 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.278686 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.278742 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:48:34.281699 20503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38024:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:34.283545 20503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:34.291071 21253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.287348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:40699 (local address 127.0.0.1:52210)
0810 14:48:34.287444 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.287452 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.287490 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.287884 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.287885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.287887 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:34.287934 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.287936 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.289153 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.289154 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.289967 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.289970 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.290781 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.290782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.290859 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.290873 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.290935 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.290995 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82,"mutex_wait_us":42,"thread_start_us":70,"threads_started":1}
I20260810 14:48:34.291079 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.287583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52210 (local address 127.19.29.194:40699)
0810 14:48:34.287756 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.287760 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.287768 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:48:34.287799 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.287800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.287812 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.287880 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:34.287991 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.289048 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.290057 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.290704 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.290765 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.290823 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.290956 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.290997 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260810 14:48:34.291491 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.287415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.19.29.193:42345)
0810 14:48:34.287804 (+ 389us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.287809 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.287819 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:34.287857 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.287859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.287874 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.288092 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:34.288172 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.289090 (+ 918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.290457 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.291154 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.291243 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.291298 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.291379 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.291420 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":81,"threads_started":1}
I20260810 14:48:34.291493 21251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.287196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:42345 (local address 127.0.0.1:35444)
0810 14:48:34.287301 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.287311 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.287357 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.287981 (+ 624us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.287982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.287985 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:34.288028 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.288029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.289205 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.289207 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.290376 (+ 1169us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.290379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.291253 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.291254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.291313 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.291317 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.291369 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.291407 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":67,"threads_started":1}
I20260810 14:48:34.291559 21249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.287088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51928 (local address 127.19.29.195:45995)
0810 14:48:34.287260 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.287265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.287275 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:34.287315 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.287317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.287333 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.287405 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:34.287658 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.288733 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.290276 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.291002 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.291068 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.291130 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.291451 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.291491 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":83,"threads_started":1}
I20260810 14:48:34.291393 21247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.286991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45995 (local address 127.0.0.1:51928)
0810 14:48:34.287095 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.287129 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.287191 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.287504 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.287507 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.287510 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:34.287575 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.287577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.288835 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.288836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.290170 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.290173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.291169 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.291170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.291234 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.291238 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.291282 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.291323 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"mutex_wait_us":52,"thread_start_us":63,"threads_started":1}
I20260810 14:48:34.292243 20915 tablet_service.cc:1467] Processing CreateTablet for tablet 5efeb0868f3c43dd9f13adc95a71ea2e (DEFAULT_TABLE table=test-table [id=12473656e528469588cdd05f9960bb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:34.292299 20693 tablet_service.cc:1467] Processing CreateTablet for tablet 5efeb0868f3c43dd9f13adc95a71ea2e (DEFAULT_TABLE table=test-table [id=12473656e528469588cdd05f9960bb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:34.292626 20693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5efeb0868f3c43dd9f13adc95a71ea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:34.292627 20915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5efeb0868f3c43dd9f13adc95a71ea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:34.294675 21121 tablet_service.cc:1467] Processing CreateTablet for tablet 5efeb0868f3c43dd9f13adc95a71ea2e (DEFAULT_TABLE table=test-table [id=12473656e528469588cdd05f9960bb70]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:34.294936 21121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5efeb0868f3c43dd9f13adc95a71ea2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:34.296906 21260 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Bootstrap starting.
I20260810 14:48:34.298339 21260 tablet_bootstrap.cc:654] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:34.299060 21262 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Bootstrap starting.
I20260810 14:48:34.299654 21263 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Bootstrap starting.
I20260810 14:48:34.299793 21260 log.cc:824] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:34.300673 21262 tablet_bootstrap.cc:654] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:34.300817 21260 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: No bootstrap required, opened a new log
I20260810 14:48:34.300895 21260 ts_tablet_manager.cc:1397] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260810 14:48:34.301242 21263 tablet_bootstrap.cc:654] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:34.301760 21262 log.cc:824] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:34.302429 21263 log.cc:824] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:34.302583 21262 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: No bootstrap required, opened a new log
I20260810 14:48:34.302662 21262 ts_tablet_manager.cc:1397] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260810 14:48:34.303396 21263 tablet_bootstrap.cc:492] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: No bootstrap required, opened a new log
I20260810 14:48:34.303468 21263 ts_tablet_manager.cc:1397] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260810 14:48:34.305114 21260 raft_consensus.cc:348] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.305337 21260 raft_consensus.cc:374] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:34.305418 21260 raft_consensus.cc:729] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c72c501d69c1472cba888ec01460659e, State: Initialized, Role: FOLLOWER
I20260810 14:48:34.305577 21260 consensus_queue.cc:260] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.306037 21260 ts_tablet_manager.cc:1428] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Time spent starting tablet: real 0.005s user 0.004s sys 0.001s
I20260810 14:48:34.306075 21015 heartbeater.cc:503] Master 127.19.29.254:38987 was elected leader, sending a full tablet report...
I20260810 14:48:34.305984 21262 raft_consensus.cc:348] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.306244 21262 raft_consensus.cc:374] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:34.306313 21262 raft_consensus.cc:729] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d962ef8dd214c12a20355d03f31f087, State: Initialized, Role: FOLLOWER
I20260810 14:48:34.306478 21262 consensus_queue.cc:260] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.306793 21262 ts_tablet_manager.cc:1428] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260810 14:48:34.306845 21230 heartbeater.cc:503] Master 127.19.29.254:38987 was elected leader, sending a full tablet report...
I20260810 14:48:34.307714 21263 raft_consensus.cc:348] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.308020 21263 raft_consensus.cc:374] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:34.308073 21263 raft_consensus.cc:729] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c00a69b5536a4fb0b088cfefcf491170, State: Initialized, Role: FOLLOWER
I20260810 14:48:34.308187 21263 consensus_queue.cc:260] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.308517 20811 heartbeater.cc:503] Master 127.19.29.254:38987 was elected leader, sending a full tablet report...
I20260810 14:48:34.308573 21263 ts_tablet_manager.cc:1428] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
W20260810 14:48:34.342391 21016 tablet.cc:2369] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:48:34.434540 20815 tablet.cc:2369] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:48:34.457799 21271 raft_consensus.cc:482] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:34.457924 21271 raft_consensus.cc:504] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.458535 21271 leader_election.cc:288] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d962ef8dd214c12a20355d03f31f087 (127.19.29.195:45995), c72c501d69c1472cba888ec01460659e (127.19.29.194:40699)
I20260810 14:48:34.461687 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.458979 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:43073 (local address 127.19.29.194:40699)
0810 14:48:34.459038 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.459040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.459050 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:34.459075 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.459076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.459084 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.459124 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:34.459337 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.459816 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.460942 (+ 1126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.461319 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.461379 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.461388 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.461589 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.461627 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:48:34.461761 21273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.458864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:40699 (local address 127.19.29.193:43073)
0810 14:48:34.458960 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.458969 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.459020 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.459126 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.459126 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.459128 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:34.459270 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.459273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.459891 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.459892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.460851 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.460853 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.461387 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.461388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.461515 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.461519 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.461568 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.461611 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":52,"threads_started":1}
I20260810 14:48:34.462075 21249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.458758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:41809 (local address 127.19.29.195:45995)
0810 14:48:34.458812 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.458814 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.458874 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:48:34.458941 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.458942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.458953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.459036 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:34.459425 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.459888 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.461210 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.461697 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.461762 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.461770 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.461956 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.462001 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:48:34.462110 21272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.458661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45995 (local address 127.19.29.193:41809)
0810 14:48:34.458801 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:34.458812 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:34.458880 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:34.459089 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:34.459090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:34.459092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:34.459364 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.459366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.459959 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.459960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.461123 (+ 1163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:34.461126 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.461775 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.461776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:34.461890 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.461894 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:34.461947 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:48:34.461984 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":84,"threads_started":1}
I20260810 14:48:34.462180 20943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5efeb0868f3c43dd9f13adc95a71ea2e" candidate_uuid: "c00a69b5536a4fb0b088cfefcf491170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72c501d69c1472cba888ec01460659e" is_pre_election: true
I20260810 14:48:34.462392 20943 raft_consensus.cc:2454] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00a69b5536a4fb0b088cfefcf491170 in term 0.
I20260810 14:48:34.462556 21154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5efeb0868f3c43dd9f13adc95a71ea2e" candidate_uuid: "c00a69b5536a4fb0b088cfefcf491170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d962ef8dd214c12a20355d03f31f087" is_pre_election: true
I20260810 14:48:34.462687 21154 raft_consensus.cc:2454] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c00a69b5536a4fb0b088cfefcf491170 in term 0.
I20260810 14:48:34.462755 20618 leader_election.cc:302] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c00a69b5536a4fb0b088cfefcf491170, c72c501d69c1472cba888ec01460659e; no voters:
I20260810 14:48:34.462894 21271 raft_consensus.cc:2781] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:34.462955 21271 raft_consensus.cc:482] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:34.462972 21271 raft_consensus.cc:3037] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:34.464267 21271 raft_consensus.cc:504] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.464377 21271 leader_election.cc:288] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [CANDIDATE]: Term 1 election: Requested vote from peers 0d962ef8dd214c12a20355d03f31f087 (127.19.29.195:45995), c72c501d69c1472cba888ec01460659e (127.19.29.194:40699)
I20260810 14:48:34.464560 21154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5efeb0868f3c43dd9f13adc95a71ea2e" candidate_uuid: "c00a69b5536a4fb0b088cfefcf491170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d962ef8dd214c12a20355d03f31f087"
I20260810 14:48:34.464558 20943 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5efeb0868f3c43dd9f13adc95a71ea2e" candidate_uuid: "c00a69b5536a4fb0b088cfefcf491170" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c72c501d69c1472cba888ec01460659e"
I20260810 14:48:34.464629 21154 raft_consensus.cc:3037] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:34.464638 20943 raft_consensus.cc:3037] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:34.465477 21154 raft_consensus.cc:2454] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00a69b5536a4fb0b088cfefcf491170 in term 1.
I20260810 14:48:34.465638 20618 leader_election.cc:302] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d962ef8dd214c12a20355d03f31f087, c00a69b5536a4fb0b088cfefcf491170; no voters:
I20260810 14:48:34.465729 21271 raft_consensus.cc:2781] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:34.465914 20943 raft_consensus.cc:2454] T 5efeb0868f3c43dd9f13adc95a71ea2e P c72c501d69c1472cba888ec01460659e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c00a69b5536a4fb0b088cfefcf491170 in term 1.
I20260810 14:48:34.465970 21271 raft_consensus.cc:686] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [term 1 LEADER]: Becoming Leader. State: Replica: c00a69b5536a4fb0b088cfefcf491170, State: Running, Role: LEADER
I20260810 14:48:34.466332 21271 consensus_queue.cc:237] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } }
I20260810 14:48:34.467274 20500 catalog_manager.cc:5495] T 5efeb0868f3c43dd9f13adc95a71ea2e P c00a69b5536a4fb0b088cfefcf491170 reported cstate change: term changed from 0 to 1, leader changed from <none> to c00a69b5536a4fb0b088cfefcf491170 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "c00a69b5536a4fb0b088cfefcf491170" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d962ef8dd214c12a20355d03f31f087" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c00a69b5536a4fb0b088cfefcf491170" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c72c501d69c1472cba888ec01460659e" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 40699 } health_report { overall_health: UNKNOWN } } }
W20260810 14:48:34.502564 21231 tablet.cc:2369] T 5efeb0868f3c43dd9f13adc95a71ea2e P 0d962ef8dd214c12a20355d03f31f087: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373313, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:34.519693 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.511878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35458 (local address 127.19.29.193:42345)
0810 14:48:34.511935 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.511937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.512051 (+ 114us) server_negotiation.cc:407] Connection header received
0810 14:48:34.512142 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.512143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.512156 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.512212 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.512838 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.513315 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.514076 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.514268 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.514375 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.516697 (+ 2322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.516711 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.516712 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.516720 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.518538 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.518873 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.518876 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.518876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.518982 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.519169 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.519170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.519171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.519317 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.519471 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.519516 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.519597 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:34.542742 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.536412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35472 (local address 127.19.29.193:42345)
0810 14:48:34.536476 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.536477 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.536530 (+ 53us) server_negotiation.cc:407] Connection header received
0810 14:48:34.536588 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.536589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.536598 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.536642 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.537155 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.537654 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.538379 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.538565 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.538614 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.540702 (+ 2088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.540703 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.540704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.540711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.541895 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.542169 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.542170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.542170 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.542213 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.542362 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.542362 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.542362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.542441 (+ 79us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.542553 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.542616 (+ 63us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.542672 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[20424](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:34.563653 21254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:34.557118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.19.29.193:42345)
0810 14:48:34.557178 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:34.557180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:34.557239 (+ 59us) server_negotiation.cc:407] Connection header received
0810 14:48:34.557297 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:34.557297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:34.557307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:34.557351 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:34.557846 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.558345 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.559287 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:34.559495 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:34.559551 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:34.561512 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:34.561513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:34.561514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:34.561521 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:34.562689 (+ 1168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.562962 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.562963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.562963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.563012 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:34.563237 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:34.563238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:34.563238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:34.563358 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:34.563462 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:34.563534 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:48:34.563592 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260810 14:48:34.564448 20662 tablet_service.cc:2908] Rejecting scan request for tablet 5efeb0868f3c43dd9f13adc95a71ea2e: Uninitialized: clean time has not yet been initialized
I20260810 14:48:34.565711 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20599
I20260810 14:48:34.576558 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20823
I20260810 14:48:34.585595 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21024
I20260810 14:48:34.595604 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20448
2026-08-10T14:48:34Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2245 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[21299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[21299](info): set up 2 sockets
Aug 10 14:48:34 dist-test-slave-4tdj krb5kdc[21299](info): commencing operation
krb5kdc: starting...
W20260810 14:48:35.748880 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.125s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:35 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:35.860762 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45405
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45405
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:35.939500 21317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:35.939708 21317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:35.939739 21317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:35.940876 21317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:35.940917 21317 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:48:35.940934 21317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:35.940950 21317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:35.940964 21317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:35.940980 21317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:35.942476 21317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45405
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45405
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:35.942713 21317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:35.942905 21317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:35.947633 21327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:35.947633 21329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:35.947703 21317 server_base.cc:1034] running on GCE node
W20260810 14:48:35.947611 21325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:35.948055 21317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:35.948379 21317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:35.949517 21317 hybrid_clock.cc:648] HybridClock initialized: now 1786373315949506 us; error 30 us; skew 500 ppm
Aug 10 14:48:35 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373315, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:35.955108 21317 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:35.955495 21317 webserver.cc:460] Webserver started at http://127.19.29.254:35661/ using document root <none> and password file <none>
I20260810 14:48:35.955687 21317 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:35.955726 21317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:35.955816 21317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:35.956740 21317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "b128466e38224093afeba9f0f7f3af1d"
format_stamp: "Formatted at 2026-08-10 14:48:35 on dist-test-slave-4tdj"
server_key: "8bb8d120ed00b61f92997574d9044a17"
server_key_iv: "758adf5e13347bcde48cb813cbb64a96"
server_key_version: "encryptionkey@0"
I20260810 14:48:35.957101 21317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "b128466e38224093afeba9f0f7f3af1d"
format_stamp: "Formatted at 2026-08-10 14:48:35 on dist-test-slave-4tdj"
server_key: "8bb8d120ed00b61f92997574d9044a17"
server_key_iv: "758adf5e13347bcde48cb813cbb64a96"
server_key_version: "encryptionkey@0"
I20260810 14:48:35.958336 21317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:35.959015 21343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:35.959172 21317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:35.959247 21317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "b128466e38224093afeba9f0f7f3af1d"
format_stamp: "Formatted at 2026-08-10 14:48:35 on dist-test-slave-4tdj"
server_key: "8bb8d120ed00b61f92997574d9044a17"
server_key_iv: "758adf5e13347bcde48cb813cbb64a96"
server_key_version: "encryptionkey@0"
I20260810 14:48:35.959299 21317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:35.978674 21317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:35.980402 21317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:35.980502 21317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:35.985036 21317 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45405
I20260810 14:48:35.985113 21433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45405 every 8 connection(s)
I20260810 14:48:35.985387 21317 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:35.986052 21435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:35.988325 21435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Bootstrap starting.
I20260810 14:48:35.988907 21435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:35.989182 21435 log.cc:824] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:35.989856 21435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: No bootstrap required, opened a new log
I20260810 14:48:35.992249 21435 raft_consensus.cc:348] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } }
I20260810 14:48:35.992390 21435 raft_consensus.cc:374] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:35.992427 21435 raft_consensus.cc:729] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b128466e38224093afeba9f0f7f3af1d, State: Initialized, Role: FOLLOWER
I20260810 14:48:35.992563 21435 consensus_queue.cc:260] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } }
I20260810 14:48:35.992630 21435 raft_consensus.cc:388] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:35.992663 21435 raft_consensus.cc:482] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:35.992714 21435 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:35.993244 21435 raft_consensus.cc:504] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } }
I20260810 14:48:35.993343 21435 leader_election.cc:302] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b128466e38224093afeba9f0f7f3af1d; no voters:
I20260810 14:48:35.993510 21435 leader_election.cc:288] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:35.993566 21438 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:35.993721 21438 raft_consensus.cc:686] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [term 1 LEADER]: Becoming Leader. State: Replica: b128466e38224093afeba9f0f7f3af1d, State: Running, Role: LEADER
I20260810 14:48:35.993750 21435 sys_catalog.cc:564] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:35.993810 21438 consensus_queue.cc:237] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } }
I20260810 14:48:35.994151 21440 sys_catalog.cc:455] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b128466e38224093afeba9f0f7f3af1d. Latest consensus state: current_term: 1 leader_uuid: "b128466e38224093afeba9f0f7f3af1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } } }
I20260810 14:48:35.994148 21439 sys_catalog.cc:455] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b128466e38224093afeba9f0f7f3af1d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b128466e38224093afeba9f0f7f3af1d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45405 } } }
I20260810 14:48:35.994339 21439 sys_catalog.cc:458] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:35.994555 21455 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:35.994728 21440 sys_catalog.cc:458] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:35.995069 21455 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:35.995152 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21317
I20260810 14:48:35.995257 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:35.995424 19575 external_mini_cluster.cc:1428] Setting key a192fb0ac72a9c35b8b35f5ef32e603d
I20260810 14:48:35.996657 21455 catalog_manager.cc:1347] Generated new cluster ID: 87a0ccbcbc31438288cebafe24d5ce8d
I20260810 14:48:35.996708 21455 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:48:35 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373315, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:36.004716 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:35.995991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41530 (local address 127.19.29.254:45405)
0810 14:48:35.996163 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:35.996173 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:35.996205 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:48:35.996337 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:35.996344 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:35.996400 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:35.997252 (+ 852us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:35.997323 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:35.998203 (+ 880us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:35.998960 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:35.999559 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:35.999674 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.001757 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.001761 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.001761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.001774 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.003296 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.003629 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.003632 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.003632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.003738 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.003912 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.003912 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.003913 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.004145 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.004283 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.004379 (+ 96us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.004509 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":102,"threads_started":1}
I20260810 14:48:36.006163 21455 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:36.006721 21455 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:36.010556 21455 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Generated new TSK 0
I20260810 14:48:36.010712 21455 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:36.038561 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45405
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:36.123785 21484 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:36.123972 21484 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:36.124002 21484 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:36.125178 21484 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:36.125234 21484 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:36.125253 21484 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:36.125276 21484 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:36.126799 21484 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21484
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:36.127012 21484 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:36.127218 21484 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:48:36.132377 21484 server_base.cc:1034] running on GCE node
W20260810 14:48:36.132383 21499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:36.132390 21495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:36.132505 21494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:36.132715 21484 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:36.132917 21484 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:36.134060 21484 hybrid_clock.cc:648] HybridClock initialized: now 1786373316134047 us; error 24 us; skew 500 ppm
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:36.136358 21484 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:36.136760 21484 webserver.cc:460] Webserver started at http://127.19.29.193:33389/ using document root <none> and password file <none>
I20260810 14:48:36.136968 21484 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:36.137017 21484 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:36.137138 21484 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:36.138098 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "c2c486295e68168543ce17f342bb58fe"
server_key_iv: "6d1b8914397b74ab6f11e1e11336b9e4"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.138434 21484 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "c2c486295e68168543ce17f342bb58fe"
server_key_iv: "6d1b8914397b74ab6f11e1e11336b9e4"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.139598 21484 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:48:36.140213 21513 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.140357 21484 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:36.140427 21484 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "c2c486295e68168543ce17f342bb58fe"
server_key_iv: "6d1b8914397b74ab6f11e1e11336b9e4"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.140494 21484 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:36.155725 21484 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:36.157415 21484 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:36.157557 21484 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:36.158037 21484 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:36.158077 21484 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.158105 21484 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:36.158123 21484 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:36.164885 21484 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:35305
I20260810 14:48:36.164961 21678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:35305 every 8 connection(s)
I20260810 14:48:36.165282 21484 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:48:36.167435 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.158607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:35391 (local address 127.19.29.254:45405)
0810 14:48:36.158668 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.158671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.158891 (+ 220us) server_negotiation.cc:407] Connection header received
0810 14:48:36.159552 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.159554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.159567 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.159607 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.160424 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.161201 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.162229 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.162555 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.162627 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.164723 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.164724 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.164724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.164734 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.166212 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.166572 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.166573 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.166574 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.166628 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.166836 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.166837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.166837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.166950 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.167004 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.167254 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.167346 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:36.167567 21524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.158573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.193:35391)
0810 14:48:36.158756 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.158801 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.159438 (+ 637us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.159690 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.159694 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.160063 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.160339 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.160347 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.161286 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.161287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.162149 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.162152 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.162659 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.162660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.162795 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.163271 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.163280 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.164640 (+ 1360us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.166283 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.166303 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.166305 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.166508 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.166680 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.166681 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.166682 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.166782 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.167003 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.167010 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.167140 (+ 130us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.167224 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.167371 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":94,"threads_started":1}
I20260810 14:48:36.167970 21679 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45405
I20260810 14:48:36.168051 21679 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:36.168205 21679 heartbeater.cc:511] Master 127.19.29.254:45405 requested a full tablet report, sending...
I20260810 14:48:36.168706 21370 ts_manager.cc:194] Registered new tserver with Master: dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305)
I20260810 14:48:36.169580 21370 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:35391
I20260810 14:48:36.173448 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21484
I20260810 14:48:36.173554 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:36.173735 19575 external_mini_cluster.cc:1428] Setting key e8eeac0374423caf69e43dd9689172d4
I20260810 14:48:36.173775 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.169034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:40555 (local address 127.19.29.254:45405)
0810 14:48:36.169069 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.169070 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.169129 (+ 59us) server_negotiation.cc:407] Connection header received
0810 14:48:36.169192 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.169192 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.169199 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.169239 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.169551 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.170194 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.170896 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.171071 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.171126 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.171882 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.171882 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.171882 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.171886 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.172848 (+ 962us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.173135 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.173135 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.173135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.173175 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.173324 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.173325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.173325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.173406 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.173447 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.173656 (+ 209us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.173721 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:48:36.173799 21690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.168955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.193:40555)
0810 14:48:36.169073 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.169083 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.169143 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.169244 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.169244 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.169422 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.169483 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.169485 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.170286 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.170287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.170831 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.170834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.171124 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.171124 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.171178 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.171549 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.171553 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.171824 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.172916 (+ 1092us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.172917 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.172917 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.173071 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.173215 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.173215 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.173215 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.173278 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.173454 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.173455 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.173540 (+ 85us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.173610 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.173700 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":63,"threads_started":1}
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:36.196732 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45405
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:36.277562 21696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:36.277752 21696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:36.277774 21696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:36.278918 21696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:36.278959 21696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:36.278977 21696 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:36.278993 21696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:36.280371 21696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:36.280582 21696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:36.280764 21696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:36.285611 21710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:36.285617 21707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:36.285681 21696 server_base.cc:1034] running on GCE node
W20260810 14:48:36.285617 21708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:36.286029 21696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:36.286230 21696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:36.287364 21696 hybrid_clock.cc:648] HybridClock initialized: now 1786373316287351 us; error 29 us; skew 500 ppm
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:36.289783 21696 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:36.290243 21696 webserver.cc:460] Webserver started at http://127.19.29.194:36897/ using document root <none> and password file <none>
I20260810 14:48:36.290457 21696 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:36.290505 21696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:36.290642 21696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:36.291596 21696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "0f1b88e8a4924275bc02601360f9ff4c"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "e79a5fe4f5bee407f5d9f7ce53db9098"
server_key_iv: "bcf309ad11ad039cb47e423c952f7076"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.291930 21696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "0f1b88e8a4924275bc02601360f9ff4c"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "e79a5fe4f5bee407f5d9f7ce53db9098"
server_key_iv: "bcf309ad11ad039cb47e423c952f7076"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.293159 21696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:36.293766 21719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.294005 21696 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:36.294093 21696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "0f1b88e8a4924275bc02601360f9ff4c"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "e79a5fe4f5bee407f5d9f7ce53db9098"
server_key_iv: "bcf309ad11ad039cb47e423c952f7076"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.294165 21696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:36.320760 21696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:36.322820 21696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:36.322962 21696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:36.323572 21696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:36.323626 21696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.323657 21696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:36.323673 21696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:36.330535 21696 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:39157
I20260810 14:48:36.330597 21888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:39157 every 8 connection(s)
I20260810 14:48:36.331001 21696 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:36.331290 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21696
I20260810 14:48:36.331380 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:36.331557 19575 external_mini_cluster.cc:1428] Setting key cdb075cedf94ce2ddff3dde479f1bab2
I20260810 14:48:36.332849 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.323954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:48827 (local address 127.19.29.254:45405)
0810 14:48:36.324002 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.324004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.324218 (+ 214us) server_negotiation.cc:407] Connection header received
0810 14:48:36.324819 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.324821 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.324835 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.324887 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.325695 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.326211 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.327387 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.327615 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.327674 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.329899 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.329900 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.329901 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.329907 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.331473 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.331930 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.331932 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.331932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.331992 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.332266 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.332267 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.332268 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.332399 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.332465 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.332682 (+ 217us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.332762 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:36.332918 21728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.323946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.194:48827)
0810 14:48:36.324090 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.324130 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.324696 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.324959 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.324962 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.325326 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.325609 (+ 283us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.325617 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.326324 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.326325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.327298 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.327301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.327700 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.327701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.327841 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.328308 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.328320 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.329811 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.331549 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.331556 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.331558 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.331840 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.332049 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.332050 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.332050 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.332205 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.332459 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.332461 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.332568 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.332645 (+ 77us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.332762 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260810 14:48:36.333338 21890 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45405
I20260810 14:48:36.333427 21890 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:36.333633 21890 heartbeater.cc:511] Master 127.19.29.254:45405 requested a full tablet report, sending...
I20260810 14:48:36.333977 21371 ts_manager.cc:194] Registered new tserver with Master: 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194:39157)
I20260810 14:48:36.334393 21371 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:48827
I20260810 14:48:36.340363 21904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.334531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.194:60835)
0810 14:48:36.334770 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.334780 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.334837 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.334955 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.334956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.335150 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.335213 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.335215 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.336035 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.336036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.336524 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.336526 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.337011 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.337012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.337089 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.337453 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.337458 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.337729 (+ 271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.339316 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.339316 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.339317 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.339469 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.339679 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.339680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.339680 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.339756 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.340109 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.340109 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.340148 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.340201 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.340287 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":63,"threads_started":1}
I20260810 14:48:36.340389 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.334615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:60835 (local address 127.19.29.254:45405)
0810 14:48:36.334653 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.334655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.334836 (+ 181us) server_negotiation.cc:407] Connection header received
0810 14:48:36.334882 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.334883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.334894 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.334951 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.335284 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.335921 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.336607 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.336889 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.336959 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.337811 (+ 852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.337813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.337813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.337820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.339234 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.339537 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.339538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.339539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.339591 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.339829 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.339831 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.339831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.340028 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.340117 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.340229 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.340305 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:36.356765 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45405
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:36.438182 21906 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:36.438406 21906 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:36.438431 21906 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:36.439522 21906 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:36.439561 21906 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:36.439581 21906 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:36.439599 21906 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:36.440984 21906 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45405
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21906
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:36.441167 21906 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:36.441355 21906 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:36.446534 21914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:36.446593 21906 server_base.cc:1034] running on GCE node
W20260810 14:48:36.446534 21915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:36.446604 21917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:36.447026 21906 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:36.447257 21906 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:36.448398 21906 hybrid_clock.cc:648] HybridClock initialized: now 1786373316448380 us; error 36 us; skew 500 ppm
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:36.450963 21906 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:36.451356 21906 webserver.cc:460] Webserver started at http://127.19.29.195:40741/ using document root <none> and password file <none>
I20260810 14:48:36.451543 21906 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:36.451592 21906 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:36.451678 21906 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:36.452646 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "1e0e326b62fa47069d0e2efc4c15c520"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "f59ce5d5e9debad1d4faaf17080042a9"
server_key_iv: "863721655821370473704f7369851f51"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.452934 21906 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "1e0e326b62fa47069d0e2efc4c15c520"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "f59ce5d5e9debad1d4faaf17080042a9"
server_key_iv: "863721655821370473704f7369851f51"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.454084 21906 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:48:36.454768 21926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.454954 21906 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.455057 21906 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "1e0e326b62fa47069d0e2efc4c15c520"
format_stamp: "Formatted at 2026-08-10 14:48:36 on dist-test-slave-4tdj"
server_key: "f59ce5d5e9debad1d4faaf17080042a9"
server_key_iv: "863721655821370473704f7369851f51"
server_key_version: "encryptionkey@0"
I20260810 14:48:36.455117 21906 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:36.488979 21906 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:36.491003 21906 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:36.491142 21906 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:36.491642 21906 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:36.491688 21906 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.491716 21906 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:36.491743 21906 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.498202 21906 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:39623
I20260810 14:48:36.498262 22089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:39623 every 8 connection(s)
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:36.498615 21906 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:48:36.501287 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.492113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:42673 (local address 127.19.29.254:45405)
0810 14:48:36.492177 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.492180 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.492343 (+ 163us) server_negotiation.cc:407] Connection header received
0810 14:48:36.492820 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.492822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.492836 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.492907 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.493761 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.494614 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.496073 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.496353 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.496428 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.498974 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.498976 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.498977 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.498985 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.500226 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.500588 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.500589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.500589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.500637 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.500796 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.500796 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.500796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.500889 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.500932 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.501144 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.501202 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:36.501382 21941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.492072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.195:42673)
0810 14:48:36.492223 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.492262 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.492733 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.492966 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.492971 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.493303 (+ 332us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.493645 (+ 342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.493652 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.494714 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.494715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.495969 (+ 1254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.495973 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.496433 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.496433 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.496572 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.497060 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.497071 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.498868 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.500307 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.500314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.500315 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.500527 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.500674 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.500675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.500675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.500757 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.500933 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.500936 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.501049 (+ 113us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.501123 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.501235 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260810 14:48:36.501394 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21906
I20260810 14:48:36.501474 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:36.501654 19575 external_mini_cluster.cc:1428] Setting key dfb6cfffc3f490fbfed0853d222a6883
I20260810 14:48:36.502060 22090 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45405
I20260810 14:48:36.502146 22090 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:36.502348 22090 heartbeater.cc:511] Master 127.19.29.254:45405 requested a full tablet report, sending...
I20260810 14:48:36.502707 21369 ts_manager.cc:194] Registered new tserver with Master: 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:36.503063 21369 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:42673
I20260810 14:48:36.507961 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.503137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:55437 (local address 127.19.29.254:45405)
0810 14:48:36.503175 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.503177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.503249 (+ 72us) server_negotiation.cc:407] Connection header received
0810 14:48:36.503304 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.503305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.503314 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.503358 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.503654 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.504109 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.504775 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.504970 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.505022 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.505799 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.505800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.505801 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.505808 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.507031 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.507317 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.507318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.507318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.507368 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.507524 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.507525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.507526 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.507626 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.507679 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.507810 (+ 131us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.507876 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:48:36.507989 22099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.503085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.19.29.195:55437)
0810 14:48:36.503201 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.503210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.503262 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.503361 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.503361 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.503524 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:36.503582 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.503584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.504193 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.504194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.504709 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.504710 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.505027 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.505028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.505104 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.505439 (+ 335us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:36.505443 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:36.505706 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:36.507103 (+ 1397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.507104 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.507105 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.507257 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.507418 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:36.507419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:36.507420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:36.507475 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:36.507677 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:36.507678 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:36.507723 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.507782 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.507878 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":58,"threads_started":1}
I20260810 14:48:36.513302 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:48:36 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:36.535827 21476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.529429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41534 (local address 127.19.29.254:45405)
0810 14:48:36.529493 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.529495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.529505 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:36.529533 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.529533 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.529543 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.529589 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:36.530099 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.530617 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.531320 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.531519 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.531575 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.533730 (+ 2155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:36.533731 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:36.533732 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:36.533739 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:36.534909 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.535209 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.535209 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.535210 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.535255 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:36.535419 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:36.535420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:36.535420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:36.535539 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:36.535629 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.535701 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.535763 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 14:48:36.537241 21369 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:36.538869 21369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:36.545161 22118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:35305 (local address 127.0.0.1:54946)
0810 14:48:36.541650 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.541660 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.541710 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.542069 (+ 359us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.542070 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.542071 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:36.542111 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.542112 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.543079 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.543080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.544179 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.544182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.544885 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.544886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.544960 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.544973 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.545033 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.545087 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":26,"thread_start_us":67,"threads_started":1}
I20260810 14:48:36.545186 22121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54946 (local address 127.19.29.193:35305)
0810 14:48:36.541871 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.541874 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.541884 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:36.541920 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.541922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.541936 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.542005 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:36.542174 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.543010 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.544258 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.544812 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.544876 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.544933 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.545054 (+ 121us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.545097 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":78,"threads_started":1}
I20260810 14:48:36.545588 22116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:39623 (local address 127.0.0.1:51856)
0810 14:48:36.541221 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.541267 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.541329 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.541889 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.541889 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.541891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:36.541937 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.541938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.543125 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.543126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.544327 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.544329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.545310 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.545311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.545377 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.545381 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.545435 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.545494 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":41,"thread_start_us":61,"threads_started":1}
I20260810 14:48:36.545616 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60370 (local address 127.19.29.194:39157)
0810 14:48:36.541390 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.541394 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.541404 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:36.541439 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.541440 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.541455 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.541549 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:36.541728 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.542851 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.544439 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.545149 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.545191 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.545261 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.545469 (+ 208us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.545515 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":82,"threads_started":1}
I20260810 14:48:36.545588 22115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:39157 (local address 127.0.0.1:60370)
0810 14:48:36.541236 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.541268 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.541329 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.541562 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.541565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.541567 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:36.541631 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.541633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.542945 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.542946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.544326 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.544329 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.545316 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.545317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.545384 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.545387 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.545435 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.545494 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":83,"thread_start_us":68,"threads_started":1}
I20260810 14:48:36.545871 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.541414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51856 (local address 127.19.29.195:39623)
0810 14:48:36.541564 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.541568 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.541579 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:48:36.541618 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.541620 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.541634 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.541777 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:36.542019 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.543047 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.544420 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.545144 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.545225 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.545274 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.545742 (+ 468us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.545784 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
I20260810 14:48:36.546154 21578 tablet_service.cc:1467] Processing CreateTablet for tablet d409a519cc984805a2e55859f2d92ca7 (DEFAULT_TABLE table=test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.546557 21578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d409a519cc984805a2e55859f2d92ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.546459 21792 tablet_service.cc:1467] Processing CreateTablet for tablet d409a519cc984805a2e55859f2d92ca7 (DEFAULT_TABLE table=test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.546792 21792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d409a519cc984805a2e55859f2d92ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.546953 21989 tablet_service.cc:1467] Processing CreateTablet for tablet d409a519cc984805a2e55859f2d92ca7 (DEFAULT_TABLE table=test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.547302 21989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d409a519cc984805a2e55859f2d92ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.549773 22123 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Bootstrap starting.
I20260810 14:48:36.550236 22124 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Bootstrap starting.
I20260810 14:48:36.550428 22125 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Bootstrap starting.
I20260810 14:48:36.550590 22123 tablet_bootstrap.cc:654] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.550891 22124 tablet_bootstrap.cc:654] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.550915 22123 log.cc:824] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:36.551242 22124 log.cc:824] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:36.551273 22125 tablet_bootstrap.cc:654] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.551599 22125 log.cc:824] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:36.551838 22123 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: No bootstrap required, opened a new log
I20260810 14:48:36.551904 22123 ts_tablet_manager.cc:1397] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:36.551914 22124 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: No bootstrap required, opened a new log
I20260810 14:48:36.551986 22124 ts_tablet_manager.cc:1397] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:48:36.552352 22125 tablet_bootstrap.cc:492] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: No bootstrap required, opened a new log
I20260810 14:48:36.552513 22125 ts_tablet_manager.cc:1397] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:36.553520 22123 raft_consensus.cc:348] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.553659 22123 raft_consensus.cc:374] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.553694 22123 raft_consensus.cc:729] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f1b88e8a4924275bc02601360f9ff4c, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.553808 22123 consensus_queue.cc:260] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.554082 21890 heartbeater.cc:503] Master 127.19.29.254:45405 was elected leader, sending a full tablet report...
I20260810 14:48:36.554055 22124 raft_consensus.cc:348] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.554214 22124 raft_consensus.cc:374] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.554255 22124 raft_consensus.cc:729] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ef7db1f34aa4ae8ce755c54cbb0e, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.554389 22124 consensus_queue.cc:260] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.554476 22123 ts_tablet_manager.cc:1428] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:48:36.554401 22125 raft_consensus.cc:348] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.554546 22125 raft_consensus.cc:374] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.554584 22125 raft_consensus.cc:729] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0e326b62fa47069d0e2efc4c15c520, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.554693 21679 heartbeater.cc:503] Master 127.19.29.254:45405 was elected leader, sending a full tablet report...
I20260810 14:48:36.554687 22125 consensus_queue.cc:260] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.554694 22124 ts_tablet_manager.cc:1428] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 14:48:36.554931 22125 ts_tablet_manager.cc:1428] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:36.554957 22090 heartbeater.cc:503] Master 127.19.29.254:45405 was elected leader, sending a full tablet report...
W20260810 14:48:36.581634 21892 tablet.cc:2369] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:48:36.666028 21681 tablet.cc:2369] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:48:36.749207 22091 tablet.cc:2369] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:48:36.842269 22130 raft_consensus.cc:482] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:36.842437 22130 raft_consensus.cc:504] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.842823 22130 leader_election.cc:288] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194:39157), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:36.845620 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.843209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56085 (local address 127.19.29.194:39157)
0810 14:48:36.843255 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.843257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.843286 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:48:36.843363 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.843364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.843373 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.843421 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:36.843567 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.844061 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.844949 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.845313 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.845373 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.845383 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.845515 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.845551 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:36.845630 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.843184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:35931 (local address 127.19.29.195:39623)
0810 14:48:36.843229 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.843231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.843240 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:36.843304 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.843305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.843314 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.843359 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:36.843495 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.843971 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.844955 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.845321 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.845380 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.845388 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.845518 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.845562 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:48:36.845645 22134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.843059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:39157 (local address 127.19.29.193:56085)
0810 14:48:36.843199 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.843210 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.843303 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.843430 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.843431 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.843433 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:36.843507 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.843509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.844124 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.844125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.844869 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.844872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.845381 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.845382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.845456 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.845459 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.845504 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.845545 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
I20260810 14:48:36.845661 22135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.843021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:39623 (local address 127.19.29.193:35931)
0810 14:48:36.843174 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:36.843186 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:36.843248 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:36.843369 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:36.843370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:36.843372 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:36.843441 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.843442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.844035 (+ 593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.844043 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.844868 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:36.844871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.845387 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.845388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:36.845461 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.845464 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:36.845507 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:48:36.845548 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":41,"thread_start_us":58,"threads_started":1}
I20260810 14:48:36.845947 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d409a519cc984805a2e55859f2d92ca7" candidate_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520" is_pre_election: true
I20260810 14:48:36.846001 21828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d409a519cc984805a2e55859f2d92ca7" candidate_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f1b88e8a4924275bc02601360f9ff4c" is_pre_election: true
I20260810 14:48:36.846099 22019 raft_consensus.cc:2454] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ef7db1f34aa4ae8ce755c54cbb0e in term 0.
I20260810 14:48:36.846148 21828 raft_consensus.cc:2454] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dec8ef7db1f34aa4ae8ce755c54cbb0e in term 0.
I20260810 14:48:36.846343 21514 leader_election.cc:302] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e0e326b62fa47069d0e2efc4c15c520, dec8ef7db1f34aa4ae8ce755c54cbb0e; no voters:
I20260810 14:48:36.846516 22130 raft_consensus.cc:2781] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:36.846567 22130 raft_consensus.cc:482] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:36.846592 22130 raft_consensus.cc:3037] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:36.847289 22130 raft_consensus.cc:504] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.847400 22130 leader_election.cc:288] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [CANDIDATE]: Term 1 election: Requested vote from peers 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194:39157), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:36.847591 21828 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d409a519cc984805a2e55859f2d92ca7" candidate_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f1b88e8a4924275bc02601360f9ff4c"
I20260810 14:48:36.847620 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d409a519cc984805a2e55859f2d92ca7" candidate_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520"
I20260810 14:48:36.847681 22019 raft_consensus.cc:3037] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:36.847677 21828 raft_consensus.cc:3037] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:36.848421 21828 raft_consensus.cc:2454] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ef7db1f34aa4ae8ce755c54cbb0e in term 1.
I20260810 14:48:36.848470 22019 raft_consensus.cc:2454] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dec8ef7db1f34aa4ae8ce755c54cbb0e in term 1.
I20260810 14:48:36.848608 21517 leader_election.cc:302] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1b88e8a4924275bc02601360f9ff4c, dec8ef7db1f34aa4ae8ce755c54cbb0e; no voters:
I20260810 14:48:36.848740 22130 raft_consensus.cc:2781] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:36.848845 22130 raft_consensus.cc:686] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 LEADER]: Becoming Leader. State: Replica: dec8ef7db1f34aa4ae8ce755c54cbb0e, State: Running, Role: LEADER
I20260810 14:48:36.848932 22130 consensus_queue.cc:237] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } }
I20260810 14:48:36.849711 21369 catalog_manager.cc:5495] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e reported cstate change: term changed from 0 to 1, leader changed from <none> to dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193). New cstate: current_term: 1 leader_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } health_report { overall_health: HEALTHY } } }
I20260810 14:48:36.898447 22121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:36.895999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54958 (local address 127.19.29.193:35305)
0810 14:48:36.896063 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:36.896065 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:36.896075 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:36.896120 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:36.896121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:36.896141 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:36.896194 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:36.896336 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.896882 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.897657 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:36.897846 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:36.897901 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:36.898111 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:36.898208 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:36.898274 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:36.898350 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 14:48:36.898371 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 14:48:36.900272 22019 raft_consensus.cc:1261] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Refusing update from remote peer dec8ef7db1f34aa4ae8ce755c54cbb0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:36.900272 21828 raft_consensus.cc:1261] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Refusing update from remote peer dec8ef7db1f34aa4ae8ce755c54cbb0e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:36.900640 22137 consensus_queue.cc:1035] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:36.902848 22141 mvcc.cc:205] Tried to move back new op lower bound from 7316985106020782080 to 7316985105813688320. Current Snapshot: MvccSnapshot[applied={T|T < 7316985106020782080}]
I20260810 14:48:36.902861 22130 consensus_queue.cc:1035] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:36.907306 21369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:36.907442 21369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:36.908300 21369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Sending DeleteTablet for 3 replicas of tablet d409a519cc984805a2e55859f2d92ca7
I20260810 14:48:36.908802 21989 tablet_service.cc:1514] Processing DeleteTablet for tablet d409a519cc984805a2e55859f2d92ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:36 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:51856
I20260810 14:48:36.908938 21369 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:36.909075 21369 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:36.909161 21578 tablet_service.cc:1514] Processing DeleteTablet for tablet d409a519cc984805a2e55859f2d92ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:36 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:54946
I20260810 14:48:36.909641 22154 tablet_replica.cc:330] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: stopping tablet replica
I20260810 14:48:36.909783 22154 raft_consensus.cc:2229] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:36.909978 22154 raft_consensus.cc:2258] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:36.910342 21578 tablet_service.cc:1467] Processing CreateTablet for tablet d8002951c8814b468ddccd94c7b26b02 (DEFAULT_TABLE table=test-table [id=78485a49a52549e6a1544a68c5c862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.910473 21578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8002951c8814b468ddccd94c7b26b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.910516 22156 tablet_replica.cc:330] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: stopping tablet replica
I20260810 14:48:36.910602 22156 raft_consensus.cc:2229] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:36.910676 21792 tablet_service.cc:1514] Processing DeleteTablet for tablet d409a519cc984805a2e55859f2d92ca7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:36 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60370
I20260810 14:48:36.910724 22156 raft_consensus.cc:2258] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:36.910965 21792 tablet_service.cc:1467] Processing CreateTablet for tablet d8002951c8814b468ddccd94c7b26b02 (DEFAULT_TABLE table=test-table [id=78485a49a52549e6a1544a68c5c862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.911079 21792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8002951c8814b468ddccd94c7b26b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.911273 22156 ts_tablet_manager.cc:1905] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:36.912401 22123 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Bootstrap starting.
I20260810 14:48:36.912444 22124 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Bootstrap starting.
I20260810 14:48:36.912562 22157 tablet_replica.cc:330] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: stopping tablet replica
I20260810 14:48:36.912674 22157 raft_consensus.cc:2229] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:36.912763 22157 raft_consensus.cc:2258] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:36.912829 22123 tablet_bootstrap.cc:654] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.912842 22124 tablet_bootstrap.cc:654] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.913167 22156 ts_tablet_manager.cc:1918] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:36.913256 22156 log.cc:1196] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/d409a519cc984805a2e55859f2d92ca7
I20260810 14:48:36.912356 21989 tablet_service.cc:1467] Processing CreateTablet for tablet d8002951c8814b468ddccd94c7b26b02 (DEFAULT_TABLE table=test-table [id=78485a49a52549e6a1544a68c5c862d4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:36.913515 22124 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: No bootstrap required, opened a new log
I20260810 14:48:36.913630 21989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8002951c8814b468ddccd94c7b26b02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:36.913602 22124 ts_tablet_manager.cc:1397] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:48:36.913800 22124 raft_consensus.cc:348] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.913872 22124 raft_consensus.cc:374] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.913887 22124 raft_consensus.cc:729] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ef7db1f34aa4ae8ce755c54cbb0e, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.913926 22124 consensus_queue.cc:260] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.913925 22157 ts_tablet_manager.cc:1905] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:36.913993 22124 ts_tablet_manager.cc:1428] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.913517 22156 ts_tablet_manager.cc:1939] T d409a519cc984805a2e55859f2d92ca7 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting consensus metadata
I20260810 14:48:36.915043 22125 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Bootstrap starting.
I20260810 14:48:36.915176 21344 catalog_manager.cc:4841] TS dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305): tablet d409a519cc984805a2e55859f2d92ca7 (table test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]) successfully deleted
I20260810 14:48:36.915411 22157 ts_tablet_manager.cc:1918] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:36.915472 22157 log.cc:1196] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d409a519cc984805a2e55859f2d92ca7
I20260810 14:48:36.915627 22125 tablet_bootstrap.cc:654] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:36.915732 22157 ts_tablet_manager.cc:1939] T d409a519cc984805a2e55859f2d92ca7 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting consensus metadata
I20260810 14:48:36.915869 22154 ts_tablet_manager.cc:1905] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:36.916117 21347 catalog_manager.cc:4841] TS 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194:39157): tablet d409a519cc984805a2e55859f2d92ca7 (table test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]) successfully deleted
I20260810 14:48:36.916744 22123 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: No bootstrap required, opened a new log
I20260810 14:48:36.916749 22125 tablet_bootstrap.cc:492] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: No bootstrap required, opened a new log
I20260810 14:48:36.916793 22125 ts_tablet_manager.cc:1397] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:36.916795 22123 ts_tablet_manager.cc:1397] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 14:48:36.916937 22125 raft_consensus.cc:348] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.916937 22123 raft_consensus.cc:348] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.916996 22125 raft_consensus.cc:374] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.917006 22123 raft_consensus.cc:374] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:36.917016 22125 raft_consensus.cc:729] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0e326b62fa47069d0e2efc4c15c520, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.917027 22123 raft_consensus.cc:729] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f1b88e8a4924275bc02601360f9ff4c, State: Initialized, Role: FOLLOWER
I20260810 14:48:36.917059 22125 consensus_queue.cc:260] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.917071 22123 consensus_queue.cc:260] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:36.917137 22125 ts_tablet_manager.cc:1428] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.917187 22123 ts_tablet_manager.cc:1428] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:36.917239 22154 ts_tablet_manager.cc:1918] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:36.917292 22154 log.cc:1196] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d409a519cc984805a2e55859f2d92ca7
I20260810 14:48:36.917526 22154 ts_tablet_manager.cc:1939] T d409a519cc984805a2e55859f2d92ca7 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting consensus metadata
I20260810 14:48:36.917919 21344 catalog_manager.cc:4841] TS 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623): tablet d409a519cc984805a2e55859f2d92ca7 (table test-table [id=495a7ba5e1c84e23bc7c66e5b67e0408]) successfully deleted
I20260810 14:48:37.219380 22129 raft_consensus.cc:482] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:37.219486 22129 raft_consensus.cc:504] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.219839 22129 leader_election.cc:288] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:37.223802 22121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.220147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:33977 (local address 127.19.29.193:35305)
0810 14:48:37.220219 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.220221 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.220290 (+ 69us) server_negotiation.cc:407] Connection header received
0810 14:48:37.220361 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.220362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.220375 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.220433 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:37.220615 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.221327 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.222894 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.223463 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.223527 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.223534 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.223690 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.223730 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:48:37.223802 22120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.220342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:41835 (local address 127.19.29.195:39623)
0810 14:48:37.220400 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.220402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.220429 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:48:37.220534 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.220535 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.220541 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.220580 (+ 39us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:37.220774 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.221460 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.222849 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.223400 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.223477 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.223487 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.223693 (+ 206us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.223730 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:48:37.223852 22164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.220253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:39623 (local address 127.19.29.194:41835)
0810 14:48:37.220374 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:37.220384 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:37.220441 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:37.220597 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:37.220598 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:37.220600 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:37.220713 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.220714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.221545 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.221546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.222758 (+ 1212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.222760 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.223515 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.223516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.223620 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.223627 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 14:48:37.223679 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:48:37.223745 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"mutex_wait_us":79,"thread_start_us":38,"threads_started":1}
I20260810 14:48:37.223862 22163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.220062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:35305 (local address 127.19.29.194:33977)
0810 14:48:37.220200 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:37.220214 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:37.220300 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:37.220456 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:37.220457 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:37.220459 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:37.220545 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.220548 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.221436 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.221438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.222751 (+ 1313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.222755 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.223553 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.223554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.223620 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.223626 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:48:37.223679 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:48:37.223745 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"mutex_wait_us":4,"thread_start_us":79,"threads_started":1}
I20260810 14:48:37.224174 21614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8002951c8814b468ddccd94c7b26b02" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" is_pre_election: true
I20260810 14:48:37.224318 21614 raft_consensus.cc:2454] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 0.
I20260810 14:48:37.224326 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8002951c8814b468ddccd94c7b26b02" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520" is_pre_election: true
I20260810 14:48:37.224406 22019 raft_consensus.cc:2454] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 0.
I20260810 14:48:37.224552 21720 leader_election.cc:302] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1b88e8a4924275bc02601360f9ff4c, dec8ef7db1f34aa4ae8ce755c54cbb0e; no voters:
I20260810 14:48:37.224685 22129 raft_consensus.cc:2781] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:37.224731 22129 raft_consensus.cc:482] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:37.224750 22129 raft_consensus.cc:3037] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.225445 22129 raft_consensus.cc:504] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.225576 22129 leader_election.cc:288] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 election: Requested vote from peers dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:37.225766 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8002951c8814b468ddccd94c7b26b02" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520"
I20260810 14:48:37.225766 21614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8002951c8814b468ddccd94c7b26b02" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e"
I20260810 14:48:37.225841 21614 raft_consensus.cc:3037] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.225837 22019 raft_consensus.cc:3037] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.226470 22019 raft_consensus.cc:2454] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 1.
I20260810 14:48:37.226637 21614 raft_consensus.cc:2454] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 1.
I20260810 14:48:37.226644 21720 leader_election.cc:302] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1b88e8a4924275bc02601360f9ff4c, 1e0e326b62fa47069d0e2efc4c15c520; no voters:
I20260810 14:48:37.226723 22129 raft_consensus.cc:2781] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:37.226853 22129 raft_consensus.cc:686] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 LEADER]: Becoming Leader. State: Replica: 0f1b88e8a4924275bc02601360f9ff4c, State: Running, Role: LEADER
I20260810 14:48:37.226917 22129 consensus_queue.cc:237] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.227625 21371 catalog_manager.cc:5495] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194). New cstate: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:48:37 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373315, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:37.285620 22180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.279012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45405 (local address 127.0.0.1:41546)
0810 14:48:37.279248 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:37.279261 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:37.279335 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:37.279503 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:37.279504 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:37.279824 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:37.279870 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.279873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.280512 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.280513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.281038 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.281040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.281345 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.281346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.281390 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.281873 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:37.281878 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:37.283267 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:37.284608 (+ 1341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:37.284616 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:37.284619 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:37.284811 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:37.284983 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:37.284983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:37.284984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:37.285040 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:37.285257 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:37.285266 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:37.285312 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:48:37.285368 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:48:37.285494 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181,"mutex_wait_us":2,"thread_start_us":118,"threads_started":1}
I20260810 14:48:37.285636 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.279115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41546 (local address 127.19.29.254:45405)
0810 14:48:37.279256 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.279258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.279322 (+ 64us) server_negotiation.cc:407] Connection header received
0810 14:48:37.279391 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.279392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.279403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.279462 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:37.279950 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.280442 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.281110 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.281290 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.281343 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.283353 (+ 2010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:37.283355 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:37.283355 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:37.283362 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:37.284518 (+ 1156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.284876 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.284877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.284877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.284930 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.285090 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.285090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.285091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.285191 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:37.285257 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.285395 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.285558 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":91,"server-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260810 14:48:37.287590 21371 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:41546:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:48:37.287899 21371 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:37.289305 21792 tablet_service.cc:1467] Processing CreateTablet for tablet 0227808104d24d6fabab342debae6f32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8f6028fe6faf4b97a33889f9409f433d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:37.289341 21989 tablet_service.cc:1467] Processing CreateTablet for tablet 0227808104d24d6fabab342debae6f32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8f6028fe6faf4b97a33889f9409f433d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:37.289341 21578 tablet_service.cc:1467] Processing CreateTablet for tablet 0227808104d24d6fabab342debae6f32 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=8f6028fe6faf4b97a33889f9409f433d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:37.289506 21578 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0227808104d24d6fabab342debae6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:37.289515 21792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0227808104d24d6fabab342debae6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:37.289587 21989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0227808104d24d6fabab342debae6f32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:37.290735 22123 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: Bootstrap starting.
I20260810 14:48:37.291076 22124 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Bootstrap starting.
I20260810 14:48:37.291127 22123 tablet_bootstrap.cc:654] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:37.291370 22124 tablet_bootstrap.cc:654] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:37.291647 22125 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: Bootstrap starting.
I20260810 14:48:37.291826 22123 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: No bootstrap required, opened a new log
I20260810 14:48:37.291879 22123 ts_tablet_manager.cc:1397] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:37.292026 22123 raft_consensus.cc:348] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.292100 22123 raft_consensus.cc:374] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:37.292126 22123 raft_consensus.cc:729] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f1b88e8a4924275bc02601360f9ff4c, State: Initialized, Role: FOLLOWER
I20260810 14:48:37.292160 22125 tablet_bootstrap.cc:654] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:37.292177 22123 consensus_queue.cc:260] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.292277 22123 ts_tablet_manager.cc:1428] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:37.292415 22129 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.292490 22129 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.292869 22125 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: No bootstrap required, opened a new log
I20260810 14:48:37.292905 22124 tablet_bootstrap.cc:492] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: No bootstrap required, opened a new log
I20260810 14:48:37.292920 22125 ts_tablet_manager.cc:1397] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:37.292958 22124 ts_tablet_manager.cc:1397] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:48:37.293087 22124 raft_consensus.cc:348] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.293150 22124 raft_consensus.cc:374] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:37.293167 22124 raft_consensus.cc:729] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dec8ef7db1f34aa4ae8ce755c54cbb0e, State: Initialized, Role: FOLLOWER
I20260810 14:48:37.293159 22125 raft_consensus.cc:348] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.293211 22124 consensus_queue.cc:260] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.293243 22125 raft_consensus.cc:374] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:37.293265 22125 raft_consensus.cc:729] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e0e326b62fa47069d0e2efc4c15c520, State: Initialized, Role: FOLLOWER
I20260810 14:48:37.293299 22124 ts_tablet_manager.cc:1428] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:37.293303 22125 consensus_queue.cc:260] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.293326 22137 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.293391 22125 ts_tablet_manager.cc:1428] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:37.293402 22137 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.293450 22132 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.293550 22132 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.309715 22129 raft_consensus.cc:482] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:37.309790 22129 raft_consensus.cc:504] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.309896 22129 leader_election.cc:288] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:37.310071 21614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0227808104d24d6fabab342debae6f32" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" is_pre_election: true
I20260810 14:48:37.310094 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0227808104d24d6fabab342debae6f32" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520" is_pre_election: true
I20260810 14:48:37.310153 21614 raft_consensus.cc:2454] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 0.
I20260810 14:48:37.310179 22019 raft_consensus.cc:2454] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 0.
I20260810 14:48:37.310338 21720 leader_election.cc:302] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1b88e8a4924275bc02601360f9ff4c, dec8ef7db1f34aa4ae8ce755c54cbb0e; no voters:
I20260810 14:48:37.310438 22129 raft_consensus.cc:2781] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:37.310485 22129 raft_consensus.cc:482] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:37.310519 22129 raft_consensus.cc:3037] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.311141 22129 raft_consensus.cc:504] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.311244 22129 leader_election.cc:288] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 election: Requested vote from peers dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305), 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623)
I20260810 14:48:37.311420 22019 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0227808104d24d6fabab342debae6f32" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e0e326b62fa47069d0e2efc4c15c520"
I20260810 14:48:37.311419 21614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0227808104d24d6fabab342debae6f32" candidate_uuid: "0f1b88e8a4924275bc02601360f9ff4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e"
I20260810 14:48:37.311492 21614 raft_consensus.cc:3037] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.311492 22019 raft_consensus.cc:3037] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:37.312074 22019 raft_consensus.cc:2454] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 1.
I20260810 14:48:37.312119 21614 raft_consensus.cc:2454] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0f1b88e8a4924275bc02601360f9ff4c in term 1.
I20260810 14:48:37.312242 21720 leader_election.cc:302] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f1b88e8a4924275bc02601360f9ff4c, 1e0e326b62fa47069d0e2efc4c15c520; no voters:
I20260810 14:48:37.312337 22129 raft_consensus.cc:2781] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:37.312398 22129 raft_consensus.cc:686] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 LEADER]: Becoming Leader. State: Replica: 0f1b88e8a4924275bc02601360f9ff4c, State: Running, Role: LEADER
I20260810 14:48:37.312448 22129 consensus_queue.cc:237] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } }
I20260810 14:48:37.312754 22165 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: TxnStatusTablet state changed. Reason: New leader 0f1b88e8a4924275bc02601360f9ff4c. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.312848 22165 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:37.312976 21369 catalog_manager.cc:5495] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194). New cstate: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } health_report { overall_health: UNKNOWN } } }
I20260810 14:48:37.313064 22187 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:48:37.313966 22187 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:48:37.322377 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.319752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60372 (local address 127.19.29.194:39157)
0810 14:48:37.319813 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.319815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.319825 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:37.319855 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.319856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.319876 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.319950 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:37.320048 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.320792 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.321542 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.321834 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.321904 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.322059 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:37.322180 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:37.322255 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.322271 (+ 16us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.322308 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:48:37.322388 22180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.319565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:39157 (local address 127.0.0.1:60372)
0810 14:48:37.319633 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:37.319644 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:37.319685 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:37.319955 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:37.319956 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:37.319957 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:48:37.320002 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.320005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.320892 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.320893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.321461 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.321463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.321910 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.321911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.321962 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.321980 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:48:37.322240 (+ 260us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:48:37.322243 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:37.322266 (+ 23us) client_negotiation.cc:240] Negotiation successful
0810 14:48:37.322332 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 14:48:37.323624 22019 raft_consensus.cc:1261] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Refusing update from remote peer 0f1b88e8a4924275bc02601360f9ff4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:37.323681 21614 raft_consensus.cc:1261] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Refusing update from remote peer 0f1b88e8a4924275bc02601360f9ff4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:37.323882 22129 consensus_queue.cc:1035] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:37.324046 22129 consensus_queue.cc:1035] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:37.324451 22132 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: TxnStatusTablet state changed. Reason: New leader 0f1b88e8a4924275bc02601360f9ff4c. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.324545 22132 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.324651 22137 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: TxnStatusTablet state changed. Reason: New leader 0f1b88e8a4924275bc02601360f9ff4c. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.324729 22137 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.325264 22129 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.325337 22129 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:37.325433 22147 mvcc.cc:205] Tried to move back new op lower bound from 7316985107755761664 to 7316985107712053248. Current Snapshot: MvccSnapshot[applied={T|T < 7316985107755761664 or (T in {7316985107755761664})}]
I20260810 14:48:37.325486 22142 mvcc.cc:205] Tried to move back new op lower bound from 7316985107755761664 to 7316985107712053248. Current Snapshot: MvccSnapshot[applied={T|T < 7316985107755761664}]
I20260810 14:48:37.325627 22132 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.325695 22132 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 1e0e326b62fa47069d0e2efc4c15c520: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.326280 22165 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.326375 22165 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P 0f1b88e8a4924275bc02601360f9ff4c: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:37.326828 22137 tablet_replica.cc:439] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0f1b88e8a4924275bc02601360f9ff4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 } } peers { permanent_uuid: "0f1b88e8a4924275bc02601360f9ff4c" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 39157 } } peers { permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 } } }
I20260810 14:48:37.326907 22137 tablet_replica.cc:442] T 0227808104d24d6fabab342debae6f32 P dec8ef7db1f34aa4ae8ce755c54cbb0e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:37.330482 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.328014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60382 (local address 127.19.29.194:39157)
0810 14:48:37.328048 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.328050 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.328057 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:48:37.328077 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.328078 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.328087 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.328136 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:37.328303 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.328843 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.329881 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.330062 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.330116 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.330245 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:37.330268 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:37.330324 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.330398 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.330419 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:48:37.335769 22117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.333051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:46797 (local address 127.19.29.194:39157)
0810 14:48:37.333081 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.333082 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.333109 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:48:37.333169 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.333170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.333179 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.333230 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:37.333319 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.334004 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.335159 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.335330 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.335380 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.335567 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:37.335589 (+ 22us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:37.335620 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.335670 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.335700 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":15}
I20260810 14:48:37.335862 22197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.332907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:39157 (local address 127.19.29.194:46797)
0810 14:48:37.333052 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:37.333063 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:37.333122 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:37.333234 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:37.333235 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:37.333236 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:48:37.333275 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.333276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.334074 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.334075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.335092 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:37.335094 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.335426 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.335427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:37.335483 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.335499 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:48:37.335623 (+ 124us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:48:37.335624 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:48:37.335667 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:48:37.335721 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":2,"thread_start_us":76,"threads_started":1}
I20260810 14:48:37.337895 21614 raft_consensus.cc:1261] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Refusing update from remote peer 0f1b88e8a4924275bc02601360f9ff4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:37.337915 22019 raft_consensus.cc:1261] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Refusing update from remote peer 0f1b88e8a4924275bc02601360f9ff4c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:37.338112 22194 consensus_queue.cc:1035] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e0e326b62fa47069d0e2efc4c15c520" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:37.338223 22129 consensus_queue.cc:1035] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "dec8ef7db1f34aa4ae8ce755c54cbb0e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 35305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:37.350214 21369 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:37.350318 21369 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41534:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:37.350867 21369 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b128466e38224093afeba9f0f7f3af1d: Sending DeleteTablet for 3 replicas of tablet d8002951c8814b468ddccd94c7b26b02
I20260810 14:48:37.351106 21578 tablet_service.cc:1514] Processing DeleteTablet for tablet d8002951c8814b468ddccd94c7b26b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:37 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:54946
I20260810 14:48:37.351176 21792 tablet_service.cc:1514] Processing DeleteTablet for tablet d8002951c8814b468ddccd94c7b26b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:37 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60370
I20260810 14:48:37.351209 21989 tablet_service.cc:1514] Processing DeleteTablet for tablet d8002951c8814b468ddccd94c7b26b02 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:37 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:51856
I20260810 14:48:37.351279 22156 tablet_replica.cc:330] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: stopping tablet replica
I20260810 14:48:37.351289 22157 tablet_replica.cc:330] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: stopping tablet replica
I20260810 14:48:37.351296 22154 tablet_replica.cc:330] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: stopping tablet replica
I20260810 14:48:37.351341 22157 raft_consensus.cc:2229] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:37.351342 22154 raft_consensus.cc:2229] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:37.351341 22156 raft_consensus.cc:2229] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:37.351377 22154 raft_consensus.cc:2258] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:37.351385 22156 raft_consensus.cc:2258] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:37.351421 22157 raft_consensus.cc:2258] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:37.351701 22154 ts_tablet_manager.cc:1905] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:37.351794 22156 ts_tablet_manager.cc:1905] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:37.352139 22157 ts_tablet_manager.cc:1905] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:37.353359 22157 ts_tablet_manager.cc:1918] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:37.353365 22154 ts_tablet_manager.cc:1918] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:37.353416 22157 log.cc:1196] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d8002951c8814b468ddccd94c7b26b02
I20260810 14:48:37.353416 22154 log.cc:1196] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d8002951c8814b468ddccd94c7b26b02
I20260810 14:48:37.353407 22156 ts_tablet_manager.cc:1918] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:37.353457 22156 log.cc:1196] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/d8002951c8814b468ddccd94c7b26b02
I20260810 14:48:37.353636 22157 ts_tablet_manager.cc:1939] T d8002951c8814b468ddccd94c7b26b02 P 0f1b88e8a4924275bc02601360f9ff4c: Deleting consensus metadata
I20260810 14:48:37.353636 22154 ts_tablet_manager.cc:1939] T d8002951c8814b468ddccd94c7b26b02 P 1e0e326b62fa47069d0e2efc4c15c520: Deleting consensus metadata
I20260810 14:48:37.353688 22156 ts_tablet_manager.cc:1939] T d8002951c8814b468ddccd94c7b26b02 P dec8ef7db1f34aa4ae8ce755c54cbb0e: Deleting consensus metadata
I20260810 14:48:37.353947 21344 catalog_manager.cc:4841] TS 1e0e326b62fa47069d0e2efc4c15c520 (127.19.29.195:39623): tablet d8002951c8814b468ddccd94c7b26b02 (table test-table [id=78485a49a52549e6a1544a68c5c862d4]) successfully deleted
I20260810 14:48:37.354043 21344 catalog_manager.cc:4841] TS dec8ef7db1f34aa4ae8ce755c54cbb0e (127.19.29.193:35305): tablet d8002951c8814b468ddccd94c7b26b02 (table test-table [id=78485a49a52549e6a1544a68c5c862d4]) successfully deleted
I20260810 14:48:37.354116 21347 catalog_manager.cc:4841] TS 0f1b88e8a4924275bc02601360f9ff4c (127.19.29.194:39157): tablet d8002951c8814b468ddccd94c7b26b02 (table test-table [id=78485a49a52549e6a1544a68c5c862d4]) successfully deleted
Aug 10 14:48:37 dist-test-slave-4tdj krb5kdc[21299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373316, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:37.362219 22121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.353938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54962 (local address 127.19.29.193:35305)
0810 14:48:37.354111 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.354114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.354357 (+ 243us) server_negotiation.cc:407] Connection header received
0810 14:48:37.354417 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.354418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.354429 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.354473 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:37.354988 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.355452 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.356132 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.356324 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.356376 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.359589 (+ 3213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:37.359598 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:37.359599 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:37.359606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:37.361103 (+ 1497us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.361463 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.361466 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.361467 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.361523 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.361711 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.361712 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.361713 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.361848 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:37.361980 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.362042 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.362129 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147}
W20260810 14:48:37.362541 21670 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54962
I20260810 14:48:37.368718 22181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:37.363444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41560 (local address 127.19.29.254:45405)
0810 14:48:37.363493 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:37.363494 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:37.363503 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:37.363564 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:37.363564 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:37.363575 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:37.363632 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:37.364072 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.364547 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.365176 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:37.365416 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:37.365470 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:37.366489 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:37.366490 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:37.366490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:37.366497 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:37.367714 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.367993 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.367994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.367994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.368072 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:37.368231 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:37.368231 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:37.368232 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:37.368336 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:37.368419 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:37.368542 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 14:48:37.368629 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260810 14:48:37.368937 21369 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41560
I20260810 14:48:37.369490 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21484
I20260810 14:48:37.388612 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21696
I20260810 14:48:37.400274 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21906
I20260810 14:48:37.410274 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21317
2026-08-10T14:48:37Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2812 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:37 dist-test-slave-4tdj krb5kdc[22214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:37 dist-test-slave-4tdj krb5kdc[22214](info): set up 2 sockets
Aug 10 14:48:37 dist-test-slave-4tdj krb5kdc[22214](info): commencing operation
krb5kdc: starting...
W20260810 14:48:38.566421 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:38 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:38.677989 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46773
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:46773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:38.757711 22230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:38.757900 22230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:38.757920 22230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:38.759039 22230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:38.759079 22230 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:48:38.759090 22230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:38.759102 22230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:38.759124 22230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:38.759147 22230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:38.760576 22230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:46773
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:38.760795 22230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:38.760990 22230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:38.765590 22244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:38.765628 22241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:38.765616 22230 server_base.cc:1034] running on GCE node
W20260810 14:48:38.765591 22240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:38.766111 22230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:38.766396 22230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:38.767547 22230 hybrid_clock.cc:648] HybridClock initialized: now 1786373318767523 us; error 41 us; skew 500 ppm
Aug 10 14:48:38 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:38.769975 22230 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:38.770443 22230 webserver.cc:460] Webserver started at http://127.19.29.254:43755/ using document root <none> and password file <none>
I20260810 14:48:38.770663 22230 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:38.770704 22230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:38.770826 22230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:38.771813 22230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "2f3d4dd824104ac599f19852388c0d84"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "03ff65827631862e6884b1f7d01a2915"
server_key_iv: "c9b6091c89d1de446d372abf8d6b6b54"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.772147 22230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "2f3d4dd824104ac599f19852388c0d84"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "03ff65827631862e6884b1f7d01a2915"
server_key_iv: "c9b6091c89d1de446d372abf8d6b6b54"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.773316 22230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:38.773950 22252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:38.774107 22230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:38.774180 22230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "2f3d4dd824104ac599f19852388c0d84"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "03ff65827631862e6884b1f7d01a2915"
server_key_iv: "c9b6091c89d1de446d372abf8d6b6b54"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.774246 22230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:38.787631 22230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:38.789791 22230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:38.789932 22230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:38.794597 22230 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:46773
I20260810 14:48:38.794672 22346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:46773 every 8 connection(s)
I20260810 14:48:38.794967 22230 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:38.795658 22347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:38.797948 22347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Bootstrap starting.
I20260810 14:48:38.798574 22347 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:38.798846 22347 log.cc:824] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:38.799526 22347 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: No bootstrap required, opened a new log
I20260810 14:48:38.801543 22347 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } }
I20260810 14:48:38.801680 22347 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:38.801712 22347 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f3d4dd824104ac599f19852388c0d84, State: Initialized, Role: FOLLOWER
I20260810 14:48:38.801836 22347 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } }
I20260810 14:48:38.801895 22347 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:38.801924 22347 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:38.801971 22347 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:38.802505 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22230
I20260810 14:48:38.802595 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:38.802574 22347 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } }
I20260810 14:48:38.802670 22347 leader_election.cc:302] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f3d4dd824104ac599f19852388c0d84; no voters:
I20260810 14:48:38.802774 19575 external_mini_cluster.cc:1428] Setting key 29d54fa85c1bac0442ae9bddfa30033f
I20260810 14:48:38.802841 22347 leader_election.cc:288] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:38.802884 22352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:38.803068 22352 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [term 1 LEADER]: Becoming Leader. State: Replica: 2f3d4dd824104ac599f19852388c0d84, State: Running, Role: LEADER
I20260810 14:48:38.803090 22347 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:38.803160 22352 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } }
I20260810 14:48:38.803555 22355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f3d4dd824104ac599f19852388c0d84. Latest consensus state: current_term: 1 leader_uuid: "2f3d4dd824104ac599f19852388c0d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } } }
I20260810 14:48:38.803647 22355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:38.803746 22353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f3d4dd824104ac599f19852388c0d84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f3d4dd824104ac599f19852388c0d84" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46773 } } }
I20260810 14:48:38.803880 22353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:38.804340 22370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:38.804945 22370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:38.806324 22370 catalog_manager.cc:1347] Generated new cluster ID: 0979c6dab77f46bf97278bb12d2fb480
I20260810 14:48:38.806375 22370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:38.809911 22370 catalog_manager.cc:1370] Generated new certificate authority record
Aug 10 14:48:38 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:38.811324 22370 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:38.814419 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:38.803365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38010 (local address 127.19.29.254:46773)
0810 14:48:38.803667 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:38.803677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:38.803713 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:48:38.803831 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:38.803837 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:38.803890 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:38.804040 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:38.804862 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.806213 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.807287 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.807896 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.807995 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:38.810721 (+ 2726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:38.810726 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:38.810726 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:38.810738 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:38.812685 (+ 1947us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.813046 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.813049 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.813049 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.813154 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.813336 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.813337 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.813337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.813606 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:38.813762 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:38.814040 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 14:48:38.814189 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":243,"thread_start_us":64,"threads_started":1}
I20260810 14:48:38.817716 22370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Generated new TSK 0
I20260810 14:48:38.817873 22370 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:38.841112 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46773
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:38.920768 22390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:38.920955 22390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:38.920977 22390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:38.922091 22390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:38.922130 22390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:38.922149 22390 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:48:38.922159 22390 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:38.922179 22390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:38.923640 22390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:46773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:38.923866 22390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:38.924079 22390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:38.929080 22398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:38.929121 22390 server_base.cc:1034] running on GCE node
W20260810 14:48:38.929088 22400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:38.929098 22396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:38.929455 22390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:38.929749 22390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:38.930917 22390 hybrid_clock.cc:648] HybridClock initialized: now 1786373318930898 us; error 31 us; skew 500 ppm
Aug 10 14:48:38 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:38.933290 22390 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:38.933710 22390 webserver.cc:460] Webserver started at http://127.19.29.193:38737/ using document root <none> and password file <none>
I20260810 14:48:38.933911 22390 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:38.933959 22390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:38.934080 22390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:38.935221 22390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "7036d66a6582a58e57471934240958ee"
server_key_iv: "cde68dbf339223d0cc52a14eaf2fff31"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.935549 22390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "7036d66a6582a58e57471934240958ee"
server_key_iv: "cde68dbf339223d0cc52a14eaf2fff31"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.936765 22390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:48:38.937882 22409 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:38.938030 22390 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:48:38.938117 22390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
format_stamp: "Formatted at 2026-08-10 14:48:38 on dist-test-slave-4tdj"
server_key: "7036d66a6582a58e57471934240958ee"
server_key_iv: "cde68dbf339223d0cc52a14eaf2fff31"
server_key_version: "encryptionkey@0"
I20260810 14:48:38.938184 22390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:38.947626 22390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:38.949548 22390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:38.949671 22390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:38.950114 22390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:38.950153 22390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:38.950182 22390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:38.950207 22390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:38.956357 22390 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:32887
I20260810 14:48:38.956418 22585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:32887 every 8 connection(s)
Aug 10 14:48:38 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:38.956761 22390 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:48:38.959545 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:38.950569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48413 (local address 127.19.29.254:46773)
0810 14:48:38.950618 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:38.950621 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:38.950816 (+ 195us) server_negotiation.cc:407] Connection header received
0810 14:48:38.951285 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:38.951287 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:38.951301 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:38.951351 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:38.952104 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.952858 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.954323 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.954630 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.954711 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:38.957227 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:38.957228 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:38.957228 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:38.957237 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:38.958544 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.958882 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.958883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.958883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.958925 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.959103 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.959103 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.959103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.959193 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:38.959238 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:38.959418 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 14:48:38.959475 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:48:38.959694 22420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:38.950570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.193:48413)
0810 14:48:38.950708 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:38.950741 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:38.951189 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:38.951425 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:38.951428 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:38.951721 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:38.951981 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:38.951987 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.952976 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.952977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:38.954206 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:38.954210 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.954737 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.954738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:38.954872 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:38.955366 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:38.955377 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:38.957144 (+ 1767us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:38.958620 (+ 1476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:38.958627 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:38.958629 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:38.958830 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:38.958968 (+ 138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:38.958968 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:38.958969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:38.959062 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:38.959234 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:38.959237 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:38.959336 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 14:48:38.959406 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 14:48:38.959519 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":79,"threads_started":1}
I20260810 14:48:38.960176 22586 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46773
I20260810 14:48:38.960255 22586 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:38.960412 22586 heartbeater.cc:511] Master 127.19.29.254:46773 requested a full tablet report, sending...
I20260810 14:48:38.960907 22273 ts_manager.cc:194] Registered new tserver with Master: b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887)
I20260810 14:48:38.961530 22273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:48413
I20260810 14:48:38.966032 22597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:38.961083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.193:40931)
0810 14:48:38.961192 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:38.961201 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:38.961243 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:38.961843 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:38.961844 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:38.961986 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:38.962045 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:38.962047 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.962749 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.962750 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:38.963232 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:38.963234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.963509 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.963509 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:38.963565 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:38.963847 (+ 282us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:38.963851 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:38.964095 (+ 244us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:38.965374 (+ 1279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:38.965374 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:38.965375 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:38.965514 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:38.965641 (+ 127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:38.965641 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:38.965642 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:38.965680 (+ 38us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:38.965828 (+ 148us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:38.965828 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:38.965859 (+ 31us) client_negotiation.cc:769] Sending connection context
0810 14:48:38.965901 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:48:38.965967 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85,"thread_start_us":62,"threads_started":1}
I20260810 14:48:38.966029 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22390
I20260810 14:48:38.966073 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:38.961153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:40931 (local address 127.19.29.254:46773)
0810 14:48:38.961720 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:38.961722 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:38.961728 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:48:38.961743 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:38.961743 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:38.961752 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:38.961806 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:38.962111 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.962667 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.963292 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:38.963459 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:38.963507 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:38.964160 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:38.964161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:38.964161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:38.964167 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:38.965316 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.965567 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.965567 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.965567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.965607 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:38.965711 (+ 104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:38.965711 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:38.965711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:38.965787 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:38.965828 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:38.965926 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 14:48:38.965989 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550}
I20260810 14:48:38.966114 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:38.966271 19575 external_mini_cluster.cc:1428] Setting key 5a1cfc404fa88fa47d6d331e0e2372c4
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:38.989185 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46773
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:39.070330 22601 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:39.070533 22601 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:39.070555 22601 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:39.071637 22601 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:39.071669 22601 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:39.071687 22601 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:48:39.071697 22601 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:39.071719 22601 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:39.073097 22601 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:46773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22601
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:39.073282 22601 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:39.073454 22601 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:39.078272 22609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:39.078286 22614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:39.078356 22601 server_base.cc:1034] running on GCE node
W20260810 14:48:39.078318 22607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:39.078747 22601 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:39.078948 22601 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:39.080080 22601 hybrid_clock.cc:648] HybridClock initialized: now 1786373319080067 us; error 26 us; skew 500 ppm
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:39.082473 22601 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:39.082866 22601 webserver.cc:460] Webserver started at http://127.19.29.194:35791/ using document root <none> and password file <none>
I20260810 14:48:39.083048 22601 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:39.083091 22601 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:39.083184 22601 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:39.084129 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "a6b6a04348ce4128aadc00270638abcc"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "671c805e98d13dbfe83c49401feaa053"
server_key_iv: "c9b1fb9f5d4eea607ffe826a04208679"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.084419 22601 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "a6b6a04348ce4128aadc00270638abcc"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "671c805e98d13dbfe83c49401feaa053"
server_key_iv: "c9b1fb9f5d4eea607ffe826a04208679"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.085606 22601 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:39.086234 22621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.086418 22601 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.086503 22601 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "a6b6a04348ce4128aadc00270638abcc"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "671c805e98d13dbfe83c49401feaa053"
server_key_iv: "c9b1fb9f5d4eea607ffe826a04208679"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.086570 22601 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:39.097445 22601 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:39.099150 22601 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:39.099256 22601 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:39.099684 22601 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:39.099725 22601 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.099746 22601 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:39.099758 22601 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:39.106467 22601 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34895
I20260810 14:48:39.106561 22791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34895 every 8 connection(s)
I20260810 14:48:39.106832 22601 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:39.109056 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.100130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:38159 (local address 127.19.29.254:46773)
0810 14:48:39.100201 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.100204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.100353 (+ 149us) server_negotiation.cc:407] Connection header received
0810 14:48:39.100824 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.100825 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.100838 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.100911 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.101687 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.102455 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.103599 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.103925 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.103995 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.106688 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.106690 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.106690 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.106697 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.108023 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.108359 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.108360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.108360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.108404 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.108601 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.108601 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.108602 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.108694 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.108740 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.108927 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.108995 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:48:39.109203 22632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.100084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.194:38159)
0810 14:48:39.100232 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.100270 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.100736 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.100987 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.100991 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.101292 (+ 301us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:39.101583 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.101590 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.102554 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.102556 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.103513 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.103516 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.104035 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.104036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.104206 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.104776 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:39.104785 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:39.106584 (+ 1799us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:39.108091 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.108096 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.108098 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.108301 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.108448 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.108448 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.108449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.108546 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.108738 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:39.108741 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:39.108844 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.108916 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.109039 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":80,"threads_started":1}
I20260810 14:48:39.109637 22792 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46773
I20260810 14:48:39.109714 22792 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:39.109872 22792 heartbeater.cc:511] Master 127.19.29.254:46773 requested a full tablet report, sending...
I20260810 14:48:39.110215 22273 ts_manager.cc:194] Registered new tserver with Master: a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:39.110616 22273 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:38159
I20260810 14:48:39.113477 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22601
I20260810 14:48:39.113588 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:39.113780 19575 external_mini_cluster.cc:1428] Setting key 4d36aa74b2fb1795c216636a35c08a79
I20260810 14:48:39.115502 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.110650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:53879 (local address 127.19.29.254:46773)
0810 14:48:39.110686 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.110688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.110808 (+ 120us) server_negotiation.cc:407] Connection header received
0810 14:48:39.110860 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.110861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.110871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.110914 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.111198 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.111649 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.112289 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.112482 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.112533 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.113246 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.113247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.113247 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.113254 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.114509 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.114800 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.114801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.114801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.114853 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.115010 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.115011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.115011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.115155 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.115212 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.115350 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.115416 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:48:39.115515 22802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.110577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.194:53879)
0810 14:48:39.110744 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.110753 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.110807 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.110917 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.110917 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.111086 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:39.111135 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.111137 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.111731 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.111732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.112222 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.112223 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.112539 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.112540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.112621 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.112926 (+ 305us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:39.112930 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:39.113171 (+ 241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:39.114592 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.114594 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.114594 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.114743 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.114905 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.114906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.114907 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.114962 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.115216 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:39.115217 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:39.115262 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.115320 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.115418 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:39.137212 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46773
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:39.217131 22809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:39.217319 22809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:39.217340 22809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:39.218451 22809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:39.218490 22809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:39.218508 22809 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260810 14:48:39.218518 22809 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:48:39.218533 22809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:39.219944 22809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:46773
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:39.220145 22809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:39.220355 22809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:39.225118 22815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:39.225150 22818 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:39.225258 22809 server_base.cc:1034] running on GCE node
W20260810 14:48:39.225157 22816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:39.225517 22809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:39.225759 22809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:39.226895 22809 hybrid_clock.cc:648] HybridClock initialized: now 1786373319226886 us; error 30 us; skew 500 ppm
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:39.229310 22809 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:39.229727 22809 webserver.cc:460] Webserver started at http://127.19.29.195:42705/ using document root <none> and password file <none>
I20260810 14:48:39.229934 22809 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:39.229980 22809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:39.230106 22809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:39.231184 22809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "f55bf86e2539464db519e818cff52dca"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "fdbb7131cde4bec56dc7b161e37d7b07"
server_key_iv: "8ff03be3e9f46b0411dab69623c38b51"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.231562 22809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "f55bf86e2539464db519e818cff52dca"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "fdbb7131cde4bec56dc7b161e37d7b07"
server_key_iv: "8ff03be3e9f46b0411dab69623c38b51"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.232800 22809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:39.233493 22828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.233645 22809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:39.233731 22809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "f55bf86e2539464db519e818cff52dca"
format_stamp: "Formatted at 2026-08-10 14:48:39 on dist-test-slave-4tdj"
server_key: "fdbb7131cde4bec56dc7b161e37d7b07"
server_key_iv: "8ff03be3e9f46b0411dab69623c38b51"
server_key_version: "encryptionkey@0"
I20260810 14:48:39.233789 22809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:39.241160 22809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:39.242966 22809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:39.243101 22809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:39.243553 22809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:39.243597 22809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.243624 22809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:39.243651 22809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.249780 22809 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:38571
I20260810 14:48:39.249902 23018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:38571 every 8 connection(s)
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:39.250159 22809 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:48:39.251847 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22809
I20260810 14:48:39.251938 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:39.252136 19575 external_mini_cluster.cc:1428] Setting key d7915b1be7ce94ef47ed9b4bc957512d
I20260810 14:48:39.253311 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.244015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:37323 (local address 127.19.29.254:46773)
0810 14:48:39.244084 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.244086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.244237 (+ 151us) server_negotiation.cc:407] Connection header received
0810 14:48:39.244697 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.244698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.244713 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.244787 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.245587 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.246346 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.247765 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.248065 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.248131 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.250669 (+ 2538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.250671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.250671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.250679 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.251983 (+ 1304us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.252421 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.252422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.252423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.252486 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.252744 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.252745 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.252745 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.252862 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.252932 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.253182 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.253250 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:48:39.253449 22839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.243960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.195:37323)
0810 14:48:39.244116 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.244155 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.244612 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.244878 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.244883 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.245202 (+ 319us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:39.245474 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.245481 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.246436 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.246437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.247681 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.247685 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.248140 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.248141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.248270 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.248778 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:39.248790 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:39.250550 (+ 1760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:39.252063 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.252072 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.252074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.252356 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.252545 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.252546 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.252546 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.252685 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.252929 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:39.252935 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:39.253084 (+ 149us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.253165 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.253283 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260810 14:48:39.253891 23021 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46773
I20260810 14:48:39.253969 23021 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:39.254148 23021 heartbeater.cc:511] Master 127.19.29.254:46773 requested a full tablet report, sending...
I20260810 14:48:39.254536 22274 ts_manager.cc:194] Registered new tserver with Master: f55bf86e2539464db519e818cff52dca (127.19.29.195:38571)
I20260810 14:48:39.255013 22274 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:37323
I20260810 14:48:39.259719 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.254896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:54435 (local address 127.19.29.254:46773)
0810 14:48:39.254932 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.254933 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.255052 (+ 119us) server_negotiation.cc:407] Connection header received
0810 14:48:39.255099 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.255100 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.255111 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.255154 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.255448 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.255907 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.256557 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.256756 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.256807 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.257587 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.257588 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.257589 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.257595 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.258782 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.259076 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.259077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.259077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.259130 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.259285 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.259286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.259286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.259385 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.259459 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.259562 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.259634 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:48:39.259733 23028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.254842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.19.29.195:54435)
0810 14:48:39.254989 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.254999 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.255052 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.255158 (+ 106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.255159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.255333 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:39.255383 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.255385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.255989 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.255990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.256489 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.256490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.256811 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.256812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.256883 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.257248 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:39.257252 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:39.257508 (+ 256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:39.258854 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.258855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.258855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.259011 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.259181 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.259181 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.259182 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.259236 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.259435 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:39.259436 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:39.259478 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.259539 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.259635 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260810 14:48:39.263645 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373319, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:39.284993 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.278907 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38012 (local address 127.19.29.254:46773)
0810 14:48:39.278957 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.278959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.278968 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:39.279021 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.279022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.279032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.279076 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.279599 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.280053 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.280734 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.280909 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.280961 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.282906 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.282907 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.282908 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.282914 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.284048 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.284345 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.284346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.284346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.284394 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.284548 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.284549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.284549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.284652 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.284734 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.284834 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.284908 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:39.286510 22274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:39.288146 22274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:39.294848 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.19.29.195:38571)
0810 14:48:39.291090 (+ 404us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.291095 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.291105 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:39.291146 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.291148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.291164 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.291240 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:39.291486 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292668 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.293878 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294453 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.294528 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.294596 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.294718 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.294758 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":372,"thread_start_us":77,"threads_started":1}
I20260810 14:48:39.294839 23037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38571 (local address 127.0.0.1:49414)
0810 14:48:39.290619 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.290661 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.290741 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.291321 (+ 580us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.291322 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.291324 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:39.291389 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.291391 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292774 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.292776 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.293799 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.293802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294530 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.294531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.294611 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.294626 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.294693 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.294747 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":31,"thread_start_us":83,"threads_started":1}
I20260810 14:48:39.294987 23036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:34895 (local address 127.0.0.1:40024)
0810 14:48:39.290847 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.290858 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.290912 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.291259 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.291263 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.291266 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:39.291344 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.291346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292842 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.292843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.293795 (+ 952us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.293799 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294797 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.294798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.294852 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.294856 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.294890 (+ 34us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.294926 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"thread_start_us":58,"threads_started":1}
I20260810 14:48:39.295089 23042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:32887 (local address 127.0.0.1:56524)
0810 14:48:39.290941 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.290950 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.290990 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.291390 (+ 400us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.291391 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.291392 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:39.291420 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.291421 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292337 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.292338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.293530 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.293533 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294640 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.294642 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.294701 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.294706 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.294756 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.294802 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":91,"threads_started":1}
I20260810 14:48:39.295042 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56524 (local address 127.19.29.193:32887)
0810 14:48:39.291181 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.291186 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.291196 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:39.291237 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.291238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.291251 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.291315 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:39.291491 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292249 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.293607 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294457 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.294539 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.294599 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.294890 (+ 291us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.294933 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260810 14:48:39.295660 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.290644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40024 (local address 127.19.29.194:34895)
0810 14:48:39.291028 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.291034 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.291047 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:48:39.291094 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.291097 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.291114 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.291555 (+ 441us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:39.291631 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.292728 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.293908 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.294684 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.295411 (+ 727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.295492 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.295520 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.295561 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":94,"threads_started":1}
I20260810 14:48:39.295756 22916 tablet_service.cc:1467] Processing CreateTablet for tablet 094110b669524976adceedd9ca224d1c (DEFAULT_TABLE table=test-table [id=f362adc539f34182952051db8d48f0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.295811 22486 tablet_service.cc:1467] Processing CreateTablet for tablet 094110b669524976adceedd9ca224d1c (DEFAULT_TABLE table=test-table [id=f362adc539f34182952051db8d48f0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.296123 22916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 094110b669524976adceedd9ca224d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.296180 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 094110b669524976adceedd9ca224d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.298750 23045 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Bootstrap starting.
I20260810 14:48:39.298913 22697 tablet_service.cc:1467] Processing CreateTablet for tablet 094110b669524976adceedd9ca224d1c (DEFAULT_TABLE table=test-table [id=f362adc539f34182952051db8d48f0d1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.299187 23046 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Bootstrap starting.
I20260810 14:48:39.299301 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 094110b669524976adceedd9ca224d1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.299863 23046 tablet_bootstrap.cc:654] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.300001 23045 tablet_bootstrap.cc:654] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.300222 23046 log.cc:824] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:39.300319 23045 log.cc:824] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:39.301021 23046 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: No bootstrap required, opened a new log
I20260810 14:48:39.301030 23045 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: No bootstrap required, opened a new log
I20260810 14:48:39.301095 23046 ts_tablet_manager.cc:1397] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:39.301095 23045 ts_tablet_manager.cc:1397] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:39.303208 23045 raft_consensus.cc:348] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.303208 23046 raft_consensus.cc:348] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.303377 23046 raft_consensus.cc:374] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.303376 23045 raft_consensus.cc:374] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.303413 23045 raft_consensus.cc:729] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bf86e2539464db519e818cff52dca, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.303413 23046 raft_consensus.cc:729] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27aac74a5d4490f947fb0a67d2a02c0, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.303536 23046 consensus_queue.cc:260] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.303531 23045 consensus_queue.cc:260] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.303826 23046 ts_tablet_manager.cc:1428] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:48:39.303826 23045 ts_tablet_manager.cc:1428] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:48:39.303900 23021 heartbeater.cc:503] Master 127.19.29.254:46773 was elected leader, sending a full tablet report...
I20260810 14:48:39.303964 22586 heartbeater.cc:503] Master 127.19.29.254:46773 was elected leader, sending a full tablet report...
I20260810 14:48:39.304051 23051 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Bootstrap starting.
I20260810 14:48:39.304956 23051 tablet_bootstrap.cc:654] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.305298 23051 log.cc:824] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:39.306001 23051 tablet_bootstrap.cc:492] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: No bootstrap required, opened a new log
I20260810 14:48:39.306066 23051 ts_tablet_manager.cc:1397] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:39.307389 23051 raft_consensus.cc:348] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.307511 23051 raft_consensus.cc:374] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.307533 23051 raft_consensus.cc:729] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b6a04348ce4128aadc00270638abcc, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.307614 23051 consensus_queue.cc:260] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.307832 23051 ts_tablet_manager.cc:1428] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:39.307911 22792 heartbeater.cc:503] Master 127.19.29.254:46773 was elected leader, sending a full tablet report...
W20260810 14:48:39.357707 22794 tablet.cc:2369] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:48:39.370708 23053 raft_consensus.cc:482] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:39.370831 23053 raft_consensus.cc:504] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.371136 23053 leader_election.cc:288] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895), b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887)
I20260810 14:48:39.374119 23039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.371430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:50059 (local address 127.19.29.194:34895)
0810 14:48:39.371493 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.371495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.371555 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:48:39.371585 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.371586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.371596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.371645 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:39.371829 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.372383 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373340 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.373752 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373810 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.373817 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.374005 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.374046 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:48:39.374125 23044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.371582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:45989 (local address 127.19.29.193:32887)
0810 14:48:39.371634 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.371636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.371728 (+ 92us) server_negotiation.cc:407] Connection header received
0810 14:48:39.371781 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.371782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.371793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.371849 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:39.372009 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.372522 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373390 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.373793 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373879 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.373888 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.374018 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.374054 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:48:39.374141 22839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.371345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:34895 (local address 127.19.29.195:50059)
0810 14:48:39.371418 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.371433 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.371487 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.371662 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.371663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.371666 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:39.371747 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.371749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.372457 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.372458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.373252 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.373254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.373831 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.373913 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.373918 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.373997 (+ 79us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.374042 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:48:39.374164 23057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.371470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:32887 (local address 127.19.29.195:45989)
0810 14:48:39.371659 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.371668 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.371720 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.371857 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.371858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.371860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:39.371939 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.371941 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.372610 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.372611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.373302 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.373304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.373887 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.373888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.373944 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.373948 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.374001 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.374045 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":100,"threads_started":1}
I20260810 14:48:39.374574 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "094110b669524976adceedd9ca224d1c" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc" is_pre_election: true
I20260810 14:48:39.374607 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "094110b669524976adceedd9ca224d1c" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" is_pre_election: true
I20260810 14:48:39.374719 22727 raft_consensus.cc:2454] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.374771 22510 raft_consensus.cc:2454] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.374976 22830 leader_election.cc:302] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6b6a04348ce4128aadc00270638abcc, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.375087 23053 raft_consensus.cc:2781] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:39.375156 23053 raft_consensus.cc:482] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:39.375172 23053 raft_consensus.cc:3037] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.375864 23053 raft_consensus.cc:504] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.375972 23053 leader_election.cc:288] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Requested vote from peers a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895), b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887)
I20260810 14:48:39.376138 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "094110b669524976adceedd9ca224d1c" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc"
I20260810 14:48:39.376173 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "094110b669524976adceedd9ca224d1c" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
I20260810 14:48:39.376215 22727 raft_consensus.cc:3037] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.376281 22510 raft_consensus.cc:3037] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.376932 22727 raft_consensus.cc:2454] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.377099 22830 leader_election.cc:302] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6b6a04348ce4128aadc00270638abcc, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.377115 22510 raft_consensus.cc:2454] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.377199 23053 raft_consensus.cc:2781] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:39.377374 23053 raft_consensus.cc:686] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Becoming Leader. State: Replica: f55bf86e2539464db519e818cff52dca, State: Running, Role: LEADER
I20260810 14:48:39.377462 23053 consensus_queue.cc:237] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } }
I20260810 14:48:39.378285 22274 catalog_manager.cc:5495] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bf86e2539464db519e818cff52dca (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:48:39 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373318, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:39.417624 22361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.411111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38018 (local address 127.19.29.254:46773)
0810 14:48:39.411172 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.411174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.411325 (+ 151us) server_negotiation.cc:407] Connection header received
0810 14:48:39.411392 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.411392 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.411403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.411443 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:39.411917 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.412406 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.413076 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.413253 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.413307 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.415287 (+ 1980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:39.415288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:39.415289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:39.415296 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:39.416518 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.416847 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.416848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.416848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.416896 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:39.417056 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:39.417057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:39.417057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:39.417162 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:39.417217 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.417368 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.417538 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":35}
I20260810 14:48:39.417624 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.411079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46773 (local address 127.0.0.1:38018)
0810 14:48:39.411248 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.411257 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.411329 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.411453 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.411454 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.411776 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:39.411827 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.411830 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.412478 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.412479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.412991 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.412993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.413310 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.413310 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.413373 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.413867 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:39.413872 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:39.415207 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:39.416590 (+ 1383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.416598 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.416601 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.416785 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.416945 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:39.416946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:39.416947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:39.417008 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:39.417215 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:39.417223 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:39.417269 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.417339 (+ 70us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.417470 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260810 14:48:39.419658 22274 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:38018:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:48:39.419857 22274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:39.421202 22916 tablet_service.cc:1467] Processing CreateTablet for tablet 56943bb9b7a849aa8d602a6c90f00ae2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e3f7ecc516f4517bee4b4278be9878f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:39.421252 22486 tablet_service.cc:1467] Processing CreateTablet for tablet 56943bb9b7a849aa8d602a6c90f00ae2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e3f7ecc516f4517bee4b4278be9878f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:39.421362 22916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56943bb9b7a849aa8d602a6c90f00ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.421383 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56943bb9b7a849aa8d602a6c90f00ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.422492 23045 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: Bootstrap starting.
I20260810 14:48:39.422785 23046 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: Bootstrap starting.
I20260810 14:48:39.422907 23045 tablet_bootstrap.cc:654] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.422899 22697 tablet_service.cc:1467] Processing CreateTablet for tablet 56943bb9b7a849aa8d602a6c90f00ae2 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9e3f7ecc516f4517bee4b4278be9878f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:48:39.423036 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 56943bb9b7a849aa8d602a6c90f00ae2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.423467 23046 tablet_bootstrap.cc:654] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.423646 23045 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: No bootstrap required, opened a new log
I20260810 14:48:39.423693 23045 ts_tablet_manager.cc:1397] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:39.423851 23045 raft_consensus.cc:348] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.423930 23045 raft_consensus.cc:374] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.423950 23045 raft_consensus.cc:729] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bf86e2539464db519e818cff52dca, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.423995 23045 consensus_queue.cc:260] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.424099 23045 ts_tablet_manager.cc:1428] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:39.424116 23046 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: No bootstrap required, opened a new log
I20260810 14:48:39.424153 23046 ts_tablet_manager.cc:1397] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:39.424226 23051 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: Bootstrap starting.
I20260810 14:48:39.424232 23053 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.424293 23053 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.424289 23046 raft_consensus.cc:348] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.424350 23046 raft_consensus.cc:374] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.424368 23046 raft_consensus.cc:729] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27aac74a5d4490f947fb0a67d2a02c0, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.424407 23046 consensus_queue.cc:260] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.424496 23046 ts_tablet_manager.cc:1428] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.424571 23054 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.424685 23054 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.424858 23051 tablet_bootstrap.cc:654] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.425505 23051 tablet_bootstrap.cc:492] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: No bootstrap required, opened a new log
I20260810 14:48:39.425544 23051 ts_tablet_manager.cc:1397] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:39.425657 23051 raft_consensus.cc:348] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.425704 23051 raft_consensus.cc:374] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.425716 23051 raft_consensus.cc:729] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b6a04348ce4128aadc00270638abcc, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.425746 23051 consensus_queue.cc:260] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.425827 23051 ts_tablet_manager.cc:1428] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.425880 23056 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.425957 23056 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: This TxnStatusTablet replica's current role is: FOLLOWER
W20260810 14:48:39.457500 22587 tablet.cc:2369] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:48:39.500789 23023 tablet.cc:2369] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:48:39.712924 23053 raft_consensus.cc:482] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:39.713033 23053 raft_consensus.cc:504] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.713192 23053 leader_election.cc:288] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:39.713423 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56943bb9b7a849aa8d602a6c90f00ae2" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" is_pre_election: true
I20260810 14:48:39.713516 22510 raft_consensus.cc:2454] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.713461 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56943bb9b7a849aa8d602a6c90f00ae2" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc" is_pre_election: true
I20260810 14:48:39.713594 22727 raft_consensus.cc:2454] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.713685 22830 leader_election.cc:302] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b27aac74a5d4490f947fb0a67d2a02c0, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.713897 23053 raft_consensus.cc:2781] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:39.713953 23053 raft_consensus.cc:482] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:39.713977 23053 raft_consensus.cc:3037] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.714716 23053 raft_consensus.cc:504] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.714825 23053 leader_election.cc:288] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Requested vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:39.714988 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56943bb9b7a849aa8d602a6c90f00ae2" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
I20260810 14:48:39.715021 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "56943bb9b7a849aa8d602a6c90f00ae2" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc"
I20260810 14:48:39.715070 22510 raft_consensus.cc:3037] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.715096 22727 raft_consensus.cc:3037] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.715670 22727 raft_consensus.cc:2454] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.715746 22510 raft_consensus.cc:2454] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.715824 22830 leader_election.cc:302] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6b6a04348ce4128aadc00270638abcc, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.715921 23053 raft_consensus.cc:2781] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:39.715976 23053 raft_consensus.cc:686] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Becoming Leader. State: Replica: f55bf86e2539464db519e818cff52dca, State: Running, Role: LEADER
I20260810 14:48:39.716022 23053 consensus_queue.cc:237] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.716320 23058 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: TxnStatusTablet state changed. Reason: New leader f55bf86e2539464db519e818cff52dca. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.716400 23058 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:39.716612 23077 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:48:39.716738 23077 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:48:39.716706 22273 catalog_manager.cc:5495] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bf86e2539464db519e818cff52dca (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } health_report { overall_health: HEALTHY } } }
I20260810 14:48:39.778929 23067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.775947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38571 (local address 127.0.0.1:49420)
0810 14:48:39.776013 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.776027 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.776074 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.776274 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.776275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.776277 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:48:39.776328 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.776331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.777203 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.777204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.777918 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.777921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.778406 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.778406 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.778475 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.778492 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:48:39.778783 (+ 291us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:48:39.778788 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.778811 (+ 23us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.778854 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 14:48:39.778934 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.776049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49420 (local address 127.19.29.195:38571)
0810 14:48:39.776111 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.776113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.776123 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:39.776159 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.776160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.776181 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.776260 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:39.776392 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.777128 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.778006 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.778328 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.778406 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.778604 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:39.778718 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:39.778805 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.778831 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.778854 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:48:39.780820 22510 raft_consensus.cc:1261] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.780820 22727 raft_consensus.cc:1261] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.781142 23053 consensus_queue.cc:1035] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:39.781273 23058 consensus_queue.cc:1035] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:39.782461 23054 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: TxnStatusTablet state changed. Reason: New leader f55bf86e2539464db519e818cff52dca. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.782557 23054 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.782670 23056 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: TxnStatusTablet state changed. Reason: New leader f55bf86e2539464db519e818cff52dca. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.782756 23056 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.783612 23053 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.783700 23053 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:39.783779 23056 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.783850 23056 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P a6b6a04348ce4128aadc00270638abcc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.784114 23058 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.784191 23058 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P f55bf86e2539464db519e818cff52dca: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:48:39.784307 23085 mvcc.cc:205] Tried to move back new op lower bound from 7316985117819772928 to 7316985117557190656. Current Snapshot: MvccSnapshot[applied={T|T < 7316985117819772928}]
I20260810 14:48:39.784646 23054 tablet_replica.cc:439] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } } }
I20260810 14:48:39.784729 23054 tablet_replica.cc:442] T 56943bb9b7a849aa8d602a6c90f00ae2 P b27aac74a5d4490f947fb0a67d2a02c0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:48:39.790393 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.787918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49428 (local address 127.19.29.195:38571)
0810 14:48:39.787955 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.787956 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.787966 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:39.788016 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.788017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.788027 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.788091 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:39.788170 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.788867 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.789661 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.789935 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.790009 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.790149 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:39.790181 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:39.790236 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.790280 (+ 44us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.790325 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:48:39.795153 23041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.792648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:45885 (local address 127.19.29.195:38571)
0810 14:48:39.792691 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:39.792693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:39.792724 (+ 31us) server_negotiation.cc:407] Connection header received
0810 14:48:39.792767 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:39.792768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:39.792776 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:39.792844 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:39.792947 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.793628 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.794372 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.794642 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.794713 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.794919 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:39.794949 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:39.794972 (+ 23us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:39.795073 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 14:48:39.795093 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 14:48:39.795626 23104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:39.792535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38571 (local address 127.19.29.195:45885)
0810 14:48:39.792672 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:39.792682 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:39.792730 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:39.792845 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:39.792845 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:39.792846 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:48:39.792897 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.792897 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.793717 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.793718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.794266 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:39.794267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:39.794742 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:39.794743 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:39.794805 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:39.794820 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:48:39.795005 (+ 185us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:48:39.795006 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:48:39.795457 (+ 451us) client_negotiation.cc:240] Negotiation successful
0810 14:48:39.795525 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260810 14:48:39.797822 22510 raft_consensus.cc:1261] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.797850 22727 raft_consensus.cc:1261] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.798008 23058 consensus_queue.cc:1035] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:39.798146 23094 consensus_queue.cc:1035] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:39.799311 23082 mvcc.cc:205] Tried to move back new op lower bound from 7316985117890826240 to 7316985116170903552. Current Snapshot: MvccSnapshot[applied={T|T < 7316985117890826240}]
I20260810 14:48:39.799854 23084 mvcc.cc:205] Tried to move back new op lower bound from 7316985117890826240 to 7316985116170903552. Current Snapshot: MvccSnapshot[applied={T|T < 7316985117890826240}]
I20260810 14:48:39.811976 22274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:39.812095 22274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:39.812808 22274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Sending DeleteTablet for 3 replicas of tablet 094110b669524976adceedd9ca224d1c
I20260810 14:48:39.813078 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet 094110b669524976adceedd9ca224d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:39 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:49414
I20260810 14:48:39.813097 22697 tablet_service.cc:1514] Processing DeleteTablet for tablet 094110b669524976adceedd9ca224d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:39 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40024
I20260810 14:48:39.813405 23110 tablet_replica.cc:330] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: stopping tablet replica
I20260810 14:48:39.813386 22486 tablet_service.cc:1514] Processing DeleteTablet for tablet 094110b669524976adceedd9ca224d1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:39 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:56524
I20260810 14:48:39.813387 22274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 14:48:39.813505 23110 raft_consensus.cc:2229] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Raft consensus shutting down.
W20260810 14:48:39.813539 22274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:39.813632 23110 raft_consensus.cc:2258] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:39.813925 23111 tablet_replica.cc:330] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: stopping tablet replica
I20260810 14:48:39.814090 23111 raft_consensus.cc:2229] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:39.814203 23111 raft_consensus.cc:2258] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:39.814394 23109 tablet_replica.cc:330] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: stopping tablet replica
I20260810 14:48:39.814519 23109 raft_consensus.cc:2229] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:39.814584 23109 raft_consensus.cc:2258] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:39.814870 22486 tablet_service.cc:1467] Processing CreateTablet for tablet d6580033ec224177a3755d206b17aa7b (DEFAULT_TABLE table=test-table [id=44d43139304744808d6114cd8026bb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.814934 22697 tablet_service.cc:1467] Processing CreateTablet for tablet d6580033ec224177a3755d206b17aa7b (DEFAULT_TABLE table=test-table [id=44d43139304744808d6114cd8026bb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.815008 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6580033ec224177a3755d206b17aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.814996 22913 tablet_service.cc:1467] Processing CreateTablet for tablet d6580033ec224177a3755d206b17aa7b (DEFAULT_TABLE table=test-table [id=44d43139304744808d6114cd8026bb0e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:39.815068 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6580033ec224177a3755d206b17aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.815089 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6580033ec224177a3755d206b17aa7b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:39.816377 23046 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Bootstrap starting.
I20260810 14:48:39.814949 23109 ts_tablet_manager.cc:1905] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:39.816382 23045 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Bootstrap starting.
I20260810 14:48:39.816427 23051 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Bootstrap starting.
I20260810 14:48:39.816787 23046 tablet_bootstrap.cc:654] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.816798 23045 tablet_bootstrap.cc:654] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.816891 23051 tablet_bootstrap.cc:654] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:39.814870 23111 ts_tablet_manager.cc:1905] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:39.817622 23110 ts_tablet_manager.cc:1905] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:39.818192 23109 ts_tablet_manager.cc:1918] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:39.818271 23109 log.cc:1196] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/094110b669524976adceedd9ca224d1c
I20260810 14:48:39.818584 23109 ts_tablet_manager.cc:1939] T 094110b669524976adceedd9ca224d1c P a6b6a04348ce4128aadc00270638abcc: Deleting consensus metadata
I20260810 14:48:39.819002 22254 catalog_manager.cc:4841] TS a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895): tablet 094110b669524976adceedd9ca224d1c (table test-table [id=f362adc539f34182952051db8d48f0d1]) successfully deleted
I20260810 14:48:39.819377 23110 ts_tablet_manager.cc:1918] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:39.819377 23111 ts_tablet_manager.cc:1918] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:39.819454 23111 log.cc:1196] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/094110b669524976adceedd9ca224d1c
I20260810 14:48:39.819454 23110 log.cc:1196] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/094110b669524976adceedd9ca224d1c
I20260810 14:48:39.819707 23110 ts_tablet_manager.cc:1939] T 094110b669524976adceedd9ca224d1c P f55bf86e2539464db519e818cff52dca: Deleting consensus metadata
I20260810 14:48:39.819707 23111 ts_tablet_manager.cc:1939] T 094110b669524976adceedd9ca224d1c P b27aac74a5d4490f947fb0a67d2a02c0: Deleting consensus metadata
I20260810 14:48:39.820058 22258 catalog_manager.cc:4841] TS f55bf86e2539464db519e818cff52dca (127.19.29.195:38571): tablet 094110b669524976adceedd9ca224d1c (table test-table [id=f362adc539f34182952051db8d48f0d1]) successfully deleted
I20260810 14:48:39.820081 22254 catalog_manager.cc:4841] TS b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887): tablet 094110b669524976adceedd9ca224d1c (table test-table [id=f362adc539f34182952051db8d48f0d1]) successfully deleted
I20260810 14:48:39.820300 23051 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: No bootstrap required, opened a new log
I20260810 14:48:39.820351 23051 ts_tablet_manager.cc:1397] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 14:48:39.820467 23045 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: No bootstrap required, opened a new log
I20260810 14:48:39.820488 23051 raft_consensus.cc:348] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.820531 23045 ts_tablet_manager.cc:1397] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260810 14:48:39.820549 23051 raft_consensus.cc:374] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.820567 23051 raft_consensus.cc:729] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b6a04348ce4128aadc00270638abcc, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.820604 23051 consensus_queue.cc:260] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.820689 23051 ts_tablet_manager.cc:1428] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:39.820672 23045 raft_consensus.cc:348] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.820734 23045 raft_consensus.cc:374] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.820752 23045 raft_consensus.cc:729] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bf86e2539464db519e818cff52dca, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.820789 23045 consensus_queue.cc:260] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.820884 23045 ts_tablet_manager.cc:1428] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:39.822671 23046 tablet_bootstrap.cc:492] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: No bootstrap required, opened a new log
I20260810 14:48:39.822716 23046 ts_tablet_manager.cc:1397] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260810 14:48:39.822835 23046 raft_consensus.cc:348] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.822907 23046 raft_consensus.cc:374] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:39.822925 23046 raft_consensus.cc:729] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27aac74a5d4490f947fb0a67d2a02c0, State: Initialized, Role: FOLLOWER
I20260810 14:48:39.822960 23046 consensus_queue.cc:260] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.823053 23046 ts_tablet_manager.cc:1428] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:39.902464 23058 raft_consensus.cc:482] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:39.902570 23058 raft_consensus.cc:504] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.902711 23058 leader_election.cc:288] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:39.902938 22509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6580033ec224177a3755d206b17aa7b" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" is_pre_election: true
I20260810 14:48:39.902961 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6580033ec224177a3755d206b17aa7b" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc" is_pre_election: true
I20260810 14:48:39.903045 22509 raft_consensus.cc:2454] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.903079 22727 raft_consensus.cc:2454] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:39.903210 22830 leader_election.cc:302] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b27aac74a5d4490f947fb0a67d2a02c0, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.903332 23058 raft_consensus.cc:2781] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:39.903389 23058 raft_consensus.cc:482] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:39.903416 23058 raft_consensus.cc:3037] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.904320 23058 raft_consensus.cc:504] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.904475 23058 leader_election.cc:288] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Requested vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:39.904685 22509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6580033ec224177a3755d206b17aa7b" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
I20260810 14:48:39.904688 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6580033ec224177a3755d206b17aa7b" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc"
I20260810 14:48:39.904765 22509 raft_consensus.cc:3037] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.904774 22727 raft_consensus.cc:3037] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:39.905433 22727 raft_consensus.cc:2454] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.905622 22830 leader_election.cc:302] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6b6a04348ce4128aadc00270638abcc, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:39.905622 22509 raft_consensus.cc:2454] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:39.905702 23058 raft_consensus.cc:2781] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:39.905747 23058 raft_consensus.cc:686] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Becoming Leader. State: Replica: f55bf86e2539464db519e818cff52dca, State: Running, Role: LEADER
I20260810 14:48:39.905798 23058 consensus_queue.cc:237] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:39.906389 22274 catalog_manager.cc:5495] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bf86e2539464db519e818cff52dca (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } health_report { overall_health: HEALTHY } } }
I20260810 14:48:39.913677 22727 raft_consensus.cc:1261] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.913743 22509 raft_consensus.cc:1261] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:39.913923 23058 consensus_queue.cc:1035] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:39.914006 23053 consensus_queue.cc:1035] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:48:39.918484 23082 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 14:48:41.435813 22274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:41.435927 22274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38012:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:41.436744 22274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Sending DeleteTablet for 3 replicas of tablet d6580033ec224177a3755d206b17aa7b
I20260810 14:48:41.436970 22486 tablet_service.cc:1514] Processing DeleteTablet for tablet d6580033ec224177a3755d206b17aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:56524
I20260810 14:48:41.436980 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet d6580033ec224177a3755d206b17aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:49414
I20260810 14:48:41.437047 22697 tablet_service.cc:1514] Processing DeleteTablet for tablet d6580033ec224177a3755d206b17aa7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40024
I20260810 14:48:41.437264 23151 tablet_replica.cc:330] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: stopping tablet replica
I20260810 14:48:41.437294 23150 tablet_replica.cc:330] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: stopping tablet replica
I20260810 14:48:41.437326 23151 raft_consensus.cc:2229] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:41.437345 23150 raft_consensus.cc:2229] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:41.437361 23151 raft_consensus.cc:2258] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.437397 23150 raft_consensus.cc:2258] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.437500 23152 tablet_replica.cc:330] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: stopping tablet replica
I20260810 14:48:41.437552 23152 raft_consensus.cc:2229] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:41.437587 23152 raft_consensus.cc:2258] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.437784 23150 ts_tablet_manager.cc:1905] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:41.438565 23151 ts_tablet_manager.cc:1905] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:41.439608 23152 ts_tablet_manager.cc:1905] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:41.440343 23151 ts_tablet_manager.cc:1918] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:48:41.440402 23151 log.cc:1196] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/d6580033ec224177a3755d206b17aa7b
I20260810 14:48:41.440604 23151 ts_tablet_manager.cc:1939] T d6580033ec224177a3755d206b17aa7b P b27aac74a5d4490f947fb0a67d2a02c0: Deleting consensus metadata
I20260810 14:48:41.440910 22254 catalog_manager.cc:4841] TS b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887): tablet d6580033ec224177a3755d206b17aa7b (table test-table [id=44d43139304744808d6114cd8026bb0e]) successfully deleted
I20260810 14:48:41.441094 23152 ts_tablet_manager.cc:1918] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:48:41.441143 23152 log.cc:1196] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d6580033ec224177a3755d206b17aa7b
I20260810 14:48:41.441334 23152 ts_tablet_manager.cc:1939] T d6580033ec224177a3755d206b17aa7b P a6b6a04348ce4128aadc00270638abcc: Deleting consensus metadata
I20260810 14:48:41.441594 23150 ts_tablet_manager.cc:1918] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:48:41.441605 22254 catalog_manager.cc:4841] TS a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895): tablet d6580033ec224177a3755d206b17aa7b (table test-table [id=44d43139304744808d6114cd8026bb0e]) successfully deleted
I20260810 14:48:41.441651 23150 log.cc:1196] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d6580033ec224177a3755d206b17aa7b
I20260810 14:48:41.441869 23150 ts_tablet_manager.cc:1939] T d6580033ec224177a3755d206b17aa7b P f55bf86e2539464db519e818cff52dca: Deleting consensus metadata
I20260810 14:48:41.442150 22258 catalog_manager.cc:4841] TS f55bf86e2539464db519e818cff52dca (127.19.29.195:38571): tablet d6580033ec224177a3755d206b17aa7b (table test-table [id=44d43139304744808d6114cd8026bb0e]) successfully deleted
Aug 10 14:48:41 dist-test-slave-4tdj krb5kdc[22214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373321, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:48:41 dist-test-slave-4tdj krb5kdc[22214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373321, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:41.468113 23164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:41.454026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38030 (local address 127.19.29.254:46773)
0810 14:48:41.454154 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:41.454156 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:41.454165 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:41.454218 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:41.454219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:41.454244 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:41.454311 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:41.454868 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:41.455371 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:41.456082 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:41.456275 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:41.456320 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:41.465925 (+ 9605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:41.465926 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:41.465927 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:41.465934 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:41.467236 (+ 1302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:41.467539 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:41.467540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:41.467540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:41.467597 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:41.467735 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:41.467735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:41.467736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:41.467834 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:41.467907 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:41.467973 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:48:41.468039 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":67,"threads_started":1}
I20260810 14:48:41.469506 22274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:41.469764 22274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:41.471148 22486 tablet_service.cc:1467] Processing CreateTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 (DEFAULT_TABLE table=test-table [id=dafebd215abc4fe4aa4a16f381b613ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.471200 22697 tablet_service.cc:1467] Processing CreateTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 (DEFAULT_TABLE table=test-table [id=dafebd215abc4fe4aa4a16f381b613ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.471191 22913 tablet_service.cc:1467] Processing CreateTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 (DEFAULT_TABLE table=test-table [id=dafebd215abc4fe4aa4a16f381b613ed]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.471292 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a28a9d3fc2244678dbc6d48b8aba907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.471319 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a28a9d3fc2244678dbc6d48b8aba907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.471326 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0a28a9d3fc2244678dbc6d48b8aba907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.472281 23165 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Bootstrap starting.
I20260810 14:48:41.472675 23165 tablet_bootstrap.cc:654] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.472878 23166 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Bootstrap starting.
I20260810 14:48:41.473275 23166 tablet_bootstrap.cc:654] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.473325 23165 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: No bootstrap required, opened a new log
I20260810 14:48:41.473361 23165 ts_tablet_manager.cc:1397] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.473551 23170 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Bootstrap starting.
I20260810 14:48:41.473516 23165 raft_consensus.cc:348] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.473588 23165 raft_consensus.cc:374] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.473608 23165 raft_consensus.cc:729] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27aac74a5d4490f947fb0a67d2a02c0, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.473671 23165 consensus_queue.cc:260] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.473841 23165 ts_tablet_manager.cc:1428] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:41.473888 23170 tablet_bootstrap.cc:654] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.474009 23166 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: No bootstrap required, opened a new log
I20260810 14:48:41.474099 23166 ts_tablet_manager.cc:1397] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.474236 23166 raft_consensus.cc:348] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.474355 23166 raft_consensus.cc:374] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.474393 23166 raft_consensus.cc:729] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bf86e2539464db519e818cff52dca, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.474443 23166 consensus_queue.cc:260] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.474597 23166 ts_tablet_manager.cc:1428] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:41.475030 23170 tablet_bootstrap.cc:492] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: No bootstrap required, opened a new log
I20260810 14:48:41.475087 23170 ts_tablet_manager.cc:1397] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:41.475256 23170 raft_consensus.cc:348] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.475360 23170 raft_consensus.cc:374] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.475567 23170 raft_consensus.cc:729] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b6a04348ce4128aadc00270638abcc, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.475620 23170 consensus_queue.cc:260] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.475791 23170 ts_tablet_manager.cc:1428] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.619798 23127 raft_consensus.cc:482] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:41.619903 23127 raft_consensus.cc:504] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.620069 23127 leader_election.cc:288] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:41.620280 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a28a9d3fc2244678dbc6d48b8aba907" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" is_pre_election: true
I20260810 14:48:41.620281 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a28a9d3fc2244678dbc6d48b8aba907" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc" is_pre_election: true
I20260810 14:48:41.620370 22510 raft_consensus.cc:2454] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:41.620378 22727 raft_consensus.cc:2454] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:41.620527 22830 leader_election.cc:302] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a6b6a04348ce4128aadc00270638abcc, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:41.620635 23127 raft_consensus.cc:2781] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:41.620682 23127 raft_consensus.cc:482] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:41.620695 23127 raft_consensus.cc:3037] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.621349 23127 raft_consensus.cc:504] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.621456 23127 leader_election.cc:288] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Requested vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:41.621658 22510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a28a9d3fc2244678dbc6d48b8aba907" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
I20260810 14:48:41.621649 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a28a9d3fc2244678dbc6d48b8aba907" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc"
I20260810 14:48:41.621731 22510 raft_consensus.cc:3037] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.621734 22727 raft_consensus.cc:3037] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.622315 22510 raft_consensus.cc:2454] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:41.622445 22727 raft_consensus.cc:2454] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:41.622524 22830 leader_election.cc:302] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b27aac74a5d4490f947fb0a67d2a02c0, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:41.622660 23127 raft_consensus.cc:2781] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:41.622709 23127 raft_consensus.cc:686] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Becoming Leader. State: Replica: f55bf86e2539464db519e818cff52dca, State: Running, Role: LEADER
I20260810 14:48:41.622763 23127 consensus_queue.cc:237] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.623405 22274 catalog_manager.cc:5495] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bf86e2539464db519e818cff52dca (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } health_report { overall_health: HEALTHY } } }
I20260810 14:48:41.656869 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:41.654920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49434 (local address 127.19.29.195:38571)
0810 14:48:41.655055 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:41.655057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:41.655065 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:48:41.655086 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:41.655087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:41.655097 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:41.655151 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:41.655263 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:41.655727 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:41.656389 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:41.656568 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:41.656608 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:41.656708 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:41.656732 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:41.656760 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:41.656794 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 14:48:41.656808 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
I20260810 14:48:41.658783 22727 raft_consensus.cc:1261] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:41.658805 22509 raft_consensus.cc:1261] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:41.658977 23127 consensus_queue.cc:1035] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:41.659082 23058 consensus_queue.cc:1035] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:41.668154 22274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:41.668244 22274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:41.668814 22274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Sending DeleteTablet for 3 replicas of tablet 0a28a9d3fc2244678dbc6d48b8aba907
I20260810 14:48:41.669076 22697 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40024
I20260810 14:48:41.669091 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:49414
I20260810 14:48:41.669179 23152 tablet_replica.cc:330] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: stopping tablet replica
I20260810 14:48:41.669204 22486 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a28a9d3fc2244678dbc6d48b8aba907 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:41 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:56524
I20260810 14:48:41.669229 23152 raft_consensus.cc:2229] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:41.669270 23152 raft_consensus.cc:2258] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.669304 23151 tablet_replica.cc:330] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: stopping tablet replica
I20260810 14:48:41.669344 23150 tablet_replica.cc:330] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: stopping tablet replica
I20260810 14:48:41.669360 23151 raft_consensus.cc:2229] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:41.669399 23151 raft_consensus.cc:2258] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.669400 23150 raft_consensus.cc:2229] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:41.669446 23150 raft_consensus.cc:2258] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:41.669667 23151 ts_tablet_manager.cc:1905] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:41.669679 22274 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 14:48:41.669783 23152 ts_tablet_manager.cc:1905] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260810 14:48:41.669814 22274 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:41.670900 22697 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2d9b73106470abe29df86b63ad594 (DEFAULT_TABLE table=test-table [id=f2031721334f4f6abbe7bd755ff75bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.670933 22913 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2d9b73106470abe29df86b63ad594 (DEFAULT_TABLE table=test-table [id=f2031721334f4f6abbe7bd755ff75bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.671010 22697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2d9b73106470abe29df86b63ad594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.671031 22913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2d9b73106470abe29df86b63ad594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.671278 22486 tablet_service.cc:1467] Processing CreateTablet for tablet b1c2d9b73106470abe29df86b63ad594 (DEFAULT_TABLE table=test-table [id=f2031721334f4f6abbe7bd755ff75bcf]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:41.671387 23150 ts_tablet_manager.cc:1905] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:41.671482 23152 ts_tablet_manager.cc:1918] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:41.671538 23152 log.cc:1196] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/0a28a9d3fc2244678dbc6d48b8aba907
I20260810 14:48:41.671733 23152 ts_tablet_manager.cc:1939] T 0a28a9d3fc2244678dbc6d48b8aba907 P a6b6a04348ce4128aadc00270638abcc: Deleting consensus metadata
I20260810 14:48:41.672015 22254 catalog_manager.cc:4841] TS a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895): tablet 0a28a9d3fc2244678dbc6d48b8aba907 (table test-table [id=dafebd215abc4fe4aa4a16f381b613ed]) successfully deleted
I20260810 14:48:41.672658 23150 ts_tablet_manager.cc:1918] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:41.672706 23150 log.cc:1196] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/0a28a9d3fc2244678dbc6d48b8aba907
I20260810 14:48:41.672842 23170 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Bootstrap starting.
I20260810 14:48:41.672869 23150 ts_tablet_manager.cc:1939] T 0a28a9d3fc2244678dbc6d48b8aba907 P f55bf86e2539464db519e818cff52dca: Deleting consensus metadata
I20260810 14:48:41.672951 23151 ts_tablet_manager.cc:1918] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:48:41.673008 23151 log.cc:1196] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/0a28a9d3fc2244678dbc6d48b8aba907
I20260810 14:48:41.673084 23166 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Bootstrap starting.
I20260810 14:48:41.673215 23151 ts_tablet_manager.cc:1939] T 0a28a9d3fc2244678dbc6d48b8aba907 P b27aac74a5d4490f947fb0a67d2a02c0: Deleting consensus metadata
I20260810 14:48:41.673346 22486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b1c2d9b73106470abe29df86b63ad594. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:41.673372 23166 tablet_bootstrap.cc:654] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.673372 23170 tablet_bootstrap.cc:654] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.673594 22254 catalog_manager.cc:4841] TS b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887): tablet 0a28a9d3fc2244678dbc6d48b8aba907 (table test-table [id=dafebd215abc4fe4aa4a16f381b613ed]) successfully deleted
I20260810 14:48:41.673818 22258 catalog_manager.cc:4841] TS f55bf86e2539464db519e818cff52dca (127.19.29.195:38571): tablet 0a28a9d3fc2244678dbc6d48b8aba907 (table test-table [id=dafebd215abc4fe4aa4a16f381b613ed]) successfully deleted
I20260810 14:48:41.673919 23170 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: No bootstrap required, opened a new log
I20260810 14:48:41.673966 23170 ts_tablet_manager.cc:1397] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.674064 23166 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: No bootstrap required, opened a new log
I20260810 14:48:41.674095 23170 raft_consensus.cc:348] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.674106 23166 ts_tablet_manager.cc:1397] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.674140 23170 raft_consensus.cc:374] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.674153 23170 raft_consensus.cc:729] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6b6a04348ce4128aadc00270638abcc, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.674186 23170 consensus_queue.cc:260] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.674216 23166 raft_consensus.cc:348] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.674266 23170 ts_tablet_manager.cc:1428] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:41.674271 23166 raft_consensus.cc:374] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.674314 23166 raft_consensus.cc:729] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f55bf86e2539464db519e818cff52dca, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.674355 23166 consensus_queue.cc:260] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.674440 23166 ts_tablet_manager.cc:1428] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:41.674504 23165 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0: Bootstrap starting.
I20260810 14:48:41.674906 23165 tablet_bootstrap.cc:654] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:41.675500 23165 tablet_bootstrap.cc:492] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0: No bootstrap required, opened a new log
I20260810 14:48:41.675544 23165 ts_tablet_manager.cc:1397] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:41.675666 23165 raft_consensus.cc:348] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.675719 23165 raft_consensus.cc:374] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:41.675735 23165 raft_consensus.cc:729] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b27aac74a5d4490f947fb0a67d2a02c0, State: Initialized, Role: FOLLOWER
I20260810 14:48:41.675774 23165 consensus_queue.cc:260] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.675863 23165 ts_tablet_manager.cc:1428] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:41.882149 23194 raft_consensus.cc:482] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:41.882261 23194 raft_consensus.cc:504] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.882454 23194 leader_election.cc:288] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:41.882686 22509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2d9b73106470abe29df86b63ad594" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" is_pre_election: true
I20260810 14:48:41.882709 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2d9b73106470abe29df86b63ad594" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc" is_pre_election: true
I20260810 14:48:41.882786 22509 raft_consensus.cc:2454] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:41.882805 22727 raft_consensus.cc:2454] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 0.
I20260810 14:48:41.882968 22830 leader_election.cc:302] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b27aac74a5d4490f947fb0a67d2a02c0, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:41.883076 23194 raft_consensus.cc:2781] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:41.883127 23194 raft_consensus.cc:482] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:41.883147 23194 raft_consensus.cc:3037] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.883844 23194 raft_consensus.cc:504] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.883960 23194 leader_election.cc:288] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Requested vote from peers b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887), a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895)
I20260810 14:48:41.884091 22509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2d9b73106470abe29df86b63ad594" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b27aac74a5d4490f947fb0a67d2a02c0"
I20260810 14:48:41.884121 22727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b1c2d9b73106470abe29df86b63ad594" candidate_uuid: "f55bf86e2539464db519e818cff52dca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6b6a04348ce4128aadc00270638abcc"
I20260810 14:48:41.884166 22509 raft_consensus.cc:3037] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.884184 22727 raft_consensus.cc:3037] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:41.884778 22727 raft_consensus.cc:2454] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:41.884809 22509 raft_consensus.cc:2454] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f55bf86e2539464db519e818cff52dca in term 1.
I20260810 14:48:41.884943 22830 leader_election.cc:302] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b27aac74a5d4490f947fb0a67d2a02c0, f55bf86e2539464db519e818cff52dca; no voters:
I20260810 14:48:41.885046 23194 raft_consensus.cc:2781] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:41.885098 23194 raft_consensus.cc:686] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Becoming Leader. State: Replica: f55bf86e2539464db519e818cff52dca, State: Running, Role: LEADER
I20260810 14:48:41.885149 23194 consensus_queue.cc:237] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } }
I20260810 14:48:41.885772 22274 catalog_manager.cc:5495] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca reported cstate change: term changed from 0 to 1, leader changed from <none> to f55bf86e2539464db519e818cff52dca (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f55bf86e2539464db519e818cff52dca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f55bf86e2539464db519e818cff52dca" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38571 } health_report { overall_health: HEALTHY } } }
I20260810 14:48:41.901398 22509 raft_consensus.cc:1261] T b1c2d9b73106470abe29df86b63ad594 P b27aac74a5d4490f947fb0a67d2a02c0 [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:41.901487 22727 raft_consensus.cc:1261] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Refusing update from remote peer f55bf86e2539464db519e818cff52dca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:41.901633 23194 consensus_queue.cc:1035] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "b27aac74a5d4490f947fb0a67d2a02c0" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:41.901736 23133 consensus_queue.cc:1035] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6b6a04348ce4128aadc00270638abcc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:48:41.905745 23124 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260810 14:48:43.421972 22274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:43.422077 22274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:38030:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:43.422822 22274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2f3d4dd824104ac599f19852388c0d84: Sending DeleteTablet for 3 replicas of tablet b1c2d9b73106470abe29df86b63ad594
I20260810 14:48:43.423070 22913 tablet_service.cc:1514] Processing DeleteTablet for tablet b1c2d9b73106470abe29df86b63ad594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:43 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:49414
I20260810 14:48:43.423089 22697 tablet_service.cc:1514] Processing DeleteTablet for tablet b1c2d9b73106470abe29df86b63ad594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:43 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40024
I20260810 14:48:43.423218 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22390
I20260810 14:48:43.423254 22486 tablet_service.cc:1514] Processing DeleteTablet for tablet b1c2d9b73106470abe29df86b63ad594 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:43 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:56524
I20260810 14:48:43.435034 23235 tablet_replica.cc:330] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: stopping tablet replica
I20260810 14:48:43.435176 23235 raft_consensus.cc:2229] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:43.435335 23235 raft_consensus.cc:2258] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:43.436223 23235 ts_tablet_manager.cc:1905] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:43.437826 23236 tablet_replica.cc:330] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: stopping tablet replica
I20260810 14:48:43.437954 23236 raft_consensus.cc:2229] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:43.438047 23236 raft_consensus.cc:2258] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:43.438122 23235 ts_tablet_manager.cc:1918] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:48:43.438176 23235 log.cc:1196] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/b1c2d9b73106470abe29df86b63ad594
I20260810 14:48:43.438448 23235 ts_tablet_manager.cc:1939] T b1c2d9b73106470abe29df86b63ad594 P f55bf86e2539464db519e818cff52dca: Deleting consensus metadata
I20260810 14:48:43.438512 23236 ts_tablet_manager.cc:1905] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:43.438802 22258 catalog_manager.cc:4841] TS f55bf86e2539464db519e818cff52dca (127.19.29.195:38571): tablet b1c2d9b73106470abe29df86b63ad594 (table test-table [id=f2031721334f4f6abbe7bd755ff75bcf]) successfully deleted
I20260810 14:48:43.439695 23236 ts_tablet_manager.cc:1918] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260810 14:48:43.439743 23236 log.cc:1196] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/b1c2d9b73106470abe29df86b63ad594
I20260810 14:48:43.439915 23236 ts_tablet_manager.cc:1939] T b1c2d9b73106470abe29df86b63ad594 P a6b6a04348ce4128aadc00270638abcc: Deleting consensus metadata
I20260810 14:48:43.440223 22254 catalog_manager.cc:4841] TS a6b6a04348ce4128aadc00270638abcc (127.19.29.194:34895): tablet b1c2d9b73106470abe29df86b63ad594 (table test-table [id=f2031721334f4f6abbe7bd755ff75bcf]) successfully deleted
W20260810 14:48:43.441241 22254 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:32887 (error 108)
I20260810 14:48:43.441484 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22601
I20260810 14:48:43.444039 23238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:43.441605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:32887 (local address 127.0.0.1:56540)
0810 14:48:43.443949 (+ 2344us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:43.444004 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2321,"thread_start_us":62,"threads_started":1}
W20260810 14:48:43.444160 22254 catalog_manager.cc:4584] TS b27aac74a5d4490f947fb0a67d2a02c0 (127.19.29.193:32887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b1c2d9b73106470abe29df86b63ad594: Network error: Client connection negotiation failed: client connection to 127.19.29.193:32887: connect: Connection refused (error 111)
I20260810 14:48:43.450160 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22809
I20260810 14:48:43.461575 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22230
2026-08-10T14:48:43Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6054 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:43 dist-test-slave-4tdj krb5kdc[23242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:43 dist-test-slave-4tdj krb5kdc[23242](info): set up 2 sockets
Aug 10 14:48:43 dist-test-slave-4tdj krb5kdc[23242](info): commencing operation
krb5kdc: starting...
W20260810 14:48:44.621970 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:44 dist-test-slave-4tdj krb5kdc[23242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:44.735272 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45869
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45869
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:44.815235 23262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:44.815419 23262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:44.815439 23262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:44.816489 23262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:44.816521 23262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:44.816541 23262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:44.816555 23262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:44.816569 23262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:44.817996 23262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45869
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:44.818202 23262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:44.818403 23262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:44.823191 23268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:44.823253 23262 server_base.cc:1034] running on GCE node
W20260810 14:48:44.823207 23271 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:44.823293 23277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:44.823657 23262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:44.823922 23262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:44.825057 23262 hybrid_clock.cc:648] HybridClock initialized: now 1786373324825044 us; error 29 us; skew 500 ppm
Aug 10 14:48:44 dist-test-slave-4tdj krb5kdc[23242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373324, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:44.827471 23262 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:44.827875 23262 webserver.cc:460] Webserver started at http://127.19.29.254:37163/ using document root <none> and password file <none>
I20260810 14:48:44.828076 23262 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:44.828118 23262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:44.828234 23262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:44.829205 23262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "0de640c722e84c17a7152df45f56327c"
format_stamp: "Formatted at 2026-08-10 14:48:44 on dist-test-slave-4tdj"
server_key: "46c724977cc81bbc42a1e683424e1697"
server_key_iv: "8e64adb658a1704125c4935b526d60fa"
server_key_version: "encryptionkey@0"
I20260810 14:48:44.829533 23262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "0de640c722e84c17a7152df45f56327c"
format_stamp: "Formatted at 2026-08-10 14:48:44 on dist-test-slave-4tdj"
server_key: "46c724977cc81bbc42a1e683424e1697"
server_key_iv: "8e64adb658a1704125c4935b526d60fa"
server_key_version: "encryptionkey@0"
I20260810 14:48:44.830785 23262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:44.831420 23285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:44.831565 23262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:44.831652 23262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "0de640c722e84c17a7152df45f56327c"
format_stamp: "Formatted at 2026-08-10 14:48:44 on dist-test-slave-4tdj"
server_key: "46c724977cc81bbc42a1e683424e1697"
server_key_iv: "8e64adb658a1704125c4935b526d60fa"
server_key_version: "encryptionkey@0"
I20260810 14:48:44.831714 23262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:44.867543 23262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:44.869268 23262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:44.869400 23262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:44.873174 23262 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45869
I20260810 14:48:44.873224 23372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45869 every 8 connection(s)
I20260810 14:48:44.873533 23262 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:44.874444 23373 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:44.876701 23373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: Bootstrap starting.
I20260810 14:48:44.877259 23373 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:44.877542 23373 log.cc:824] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:44.878193 23373 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: No bootstrap required, opened a new log
I20260810 14:48:44.879798 23373 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } }
I20260810 14:48:44.879948 23373 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:44.879972 23373 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0de640c722e84c17a7152df45f56327c, State: Initialized, Role: FOLLOWER
I20260810 14:48:44.880084 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23262
I20260810 14:48:44.880116 23373 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } }
I20260810 14:48:44.880182 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:44.880188 23373 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:44.880221 23373 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:44.880273 23373 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:44.880350 19575 external_mini_cluster.cc:1428] Setting key 6ced0ebd56e23196688bcca968643cbd
I20260810 14:48:44.880872 23373 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } }
I20260810 14:48:44.880987 23373 leader_election.cc:302] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0de640c722e84c17a7152df45f56327c; no voters:
I20260810 14:48:44.881157 23373 leader_election.cc:288] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:44.881182 23382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:44.881287 23382 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [term 1 LEADER]: Becoming Leader. State: Replica: 0de640c722e84c17a7152df45f56327c, State: Running, Role: LEADER
I20260810 14:48:44.881415 23373 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:44.881420 23382 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } }
I20260810 14:48:44.881799 23383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0de640c722e84c17a7152df45f56327c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } } }
I20260810 14:48:44.881873 23383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:44.882097 23390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0de640c722e84c17a7152df45f56327c. Latest consensus state: current_term: 1 leader_uuid: "0de640c722e84c17a7152df45f56327c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0de640c722e84c17a7152df45f56327c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45869 } } }
I20260810 14:48:44.882457 23390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c [sys.catalog]: This master's current role is: LEADER
W20260810 14:48:44.883510 23411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:48:44.883565 23411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:48:44.883607 23394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:44.883744 23394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 10 14:48:44 dist-test-slave-4tdj krb5kdc[23242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373324, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:44.890429 23378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:44.880791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56286 (local address 127.19.29.254:45869)
0810 14:48:44.880955 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:44.880965 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:44.881003 (+ 38us) server_negotiation.cc:407] Connection header received
0810 14:48:44.881113 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:44.881119 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:44.881161 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:44.882039 (+ 878us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:44.882146 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:44.883411 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:44.884218 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:44.884821 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:44.884916 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:44.887415 (+ 2499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:44.887419 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:44.887419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:44.887430 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:44.888924 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:44.889302 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:44.889304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:44.889304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:44.889388 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:44.889600 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:44.889601 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:44.889601 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:44.889855 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:44.889974 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:44.890108 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 14:48:44.890214 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260810 14:48:44.890707 23394 catalog_manager.cc:1347] Generated new cluster ID: b0152d8241a54432959f02b2641c6ff1
I20260810 14:48:44.890755 23394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:44.910414 23394 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:44.911126 23394 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:44.915302 23394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0de640c722e84c17a7152df45f56327c: Generated new TSK 0
I20260810 14:48:44.915519 23394 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:44.946815 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:45.029930 23417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:45.030122 23417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:45.030153 23417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:45.031352 23417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:45.031396 23417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:45.031431 23417 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:45.032866 23417 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:45.033111 23417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:45.033322 23417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:45.038228 23425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.038225 23424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.038264 23428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:45.038452 23417 server_base.cc:1034] running on GCE node
I20260810 14:48:45.038651 23417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:45.038851 23417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:45.039999 23417 hybrid_clock.cc:648] HybridClock initialized: now 1786373325039983 us; error 35 us; skew 500 ppm
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:45.042551 23417 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:45.042964 23417 webserver.cc:460] Webserver started at http://127.19.29.193:40821/ using document root <none> and password file <none>
I20260810 14:48:45.043172 23417 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:45.043217 23417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:45.043339 23417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:45.044319 23417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "5f86011e9f8c49f389ca2f1f355f3e44"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "be5651914c32a12972e31c9058e69b20"
server_key_iv: "cc8ea14d51ec8088b0a2fbae2b549573"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.044631 23417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "5f86011e9f8c49f389ca2f1f355f3e44"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "be5651914c32a12972e31c9058e69b20"
server_key_iv: "cc8ea14d51ec8088b0a2fbae2b549573"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.045833 23417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:45.046573 23437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.046736 23417 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:48:45.046833 23417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "5f86011e9f8c49f389ca2f1f355f3e44"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "be5651914c32a12972e31c9058e69b20"
server_key_iv: "cc8ea14d51ec8088b0a2fbae2b549573"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.046895 23417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:45.056993 23417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:45.058665 23417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:45.058789 23417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:45.058986 23417 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:45.059279 23417 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:45.059312 23417 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.059338 23417 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:45.059355 23417 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.064908 23417 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:43149
I20260810 14:48:45.064963 23633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:43149 every 8 connection(s)
I20260810 14:48:45.065260 23417 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:45.071707 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23417
I20260810 14:48:45.071786 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:45.071979 19575 external_mini_cluster.cc:1428] Setting key 947c7bbb66188b0358c936ba72ccb10a
I20260810 14:48:45.073890 23378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.065896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:41893 (local address 127.19.29.254:45869)
0810 14:48:45.065946 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:45.065948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:45.066161 (+ 213us) server_negotiation.cc:407] Connection header received
0810 14:48:45.066699 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:45.066701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:45.066714 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:45.066764 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:45.067623 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.068116 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.068994 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.069182 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.069224 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.071137 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:45.071139 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:45.071139 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:45.071146 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:45.072655 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.073016 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.073017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.073017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.073081 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.073291 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.073292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.073292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.073417 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:45.073476 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:45.073708 (+ 232us) server_negotiation.cc:299] Negotiation successful
0810 14:48:45.073801 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:45.073941 23636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.065870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45869 (local address 127.19.29.193:41893)
0810 14:48:45.066039 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:45.066081 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:45.066610 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:45.066816 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:45.066819 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:45.067370 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:45.067553 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.067558 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.068176 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.068177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.068936 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.068937 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.069240 (+ 303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.069241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.069341 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.069737 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:45.069745 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:45.071038 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:45.072728 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.072735 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.072737 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.072947 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.073138 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.073139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.073139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.073239 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.073472 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:45.073475 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:45.073598 (+ 123us) client_negotiation.cc:769] Sending connection context
0810 14:48:45.073674 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:48:45.073788 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":94,"threads_started":1}
I20260810 14:48:45.074513 23634 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45869
I20260810 14:48:45.074604 23634 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:45.074767 23634 heartbeater.cc:511] Master 127.19.29.254:45869 requested a full tablet report, sending...
I20260810 14:48:45.075256 23318 ts_manager.cc:194] Registered new tserver with Master: 5f86011e9f8c49f389ca2f1f355f3e44 (127.19.29.193:43149)
I20260810 14:48:45.076021 23318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:41893
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:45.094825 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:45.174273 23641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:45.174475 23641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:45.174497 23641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:45.175566 23641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:45.175595 23641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:45.175619 23641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:45.176967 23641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:45.177155 23641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:45.177328 23641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:45.182094 23648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.182075 23647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.182065 23652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:45.182205 23641 server_base.cc:1034] running on GCE node
I20260810 14:48:45.182468 23641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:45.182765 23641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:45.183902 23641 hybrid_clock.cc:648] HybridClock initialized: now 1786373325183887 us; error 29 us; skew 500 ppm
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:45.186503 23641 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:45.186906 23641 webserver.cc:460] Webserver started at http://127.19.29.194:39407/ using document root <none> and password file <none>
I20260810 14:48:45.187119 23641 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:45.187162 23641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:45.187282 23641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:45.188287 23641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "6b16cd3db0b446febbc86a80e42b45d3"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "9d59c7af7d8e361834a6a635b4923f46"
server_key_iv: "f21e912719a56dd7b4735f6e1813e279"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.188611 23641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "6b16cd3db0b446febbc86a80e42b45d3"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "9d59c7af7d8e361834a6a635b4923f46"
server_key_iv: "f21e912719a56dd7b4735f6e1813e279"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.189886 23641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:45.190626 23660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.190766 23641 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:45.190852 23641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "6b16cd3db0b446febbc86a80e42b45d3"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "9d59c7af7d8e361834a6a635b4923f46"
server_key_iv: "f21e912719a56dd7b4735f6e1813e279"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.190905 23641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:45.214525 23641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:45.216512 23641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:45.216619 23641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:45.216792 23641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:45.217041 23641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:45.217069 23641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.217088 23641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:45.217099 23641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.222618 23641 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34287
I20260810 14:48:45.222705 23845 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34287 every 8 connection(s)
I20260810 14:48:45.222962 23641 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:45.229605 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23641
I20260810 14:48:45.229699 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:45.229871 19575 external_mini_cluster.cc:1428] Setting key b773ed8557a41c321e8c8c1f9eb8156c
I20260810 14:48:45.231873 23378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.223652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:46639 (local address 127.19.29.254:45869)
0810 14:48:45.223711 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:45.223713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:45.223906 (+ 193us) server_negotiation.cc:407] Connection header received
0810 14:48:45.224457 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:45.224458 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:45.224469 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:45.224520 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:45.225409 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.225929 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.226876 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.227076 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.227125 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.229169 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:45.229170 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:45.229171 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:45.229177 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:45.230538 (+ 1361us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.230938 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.230939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.230940 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.231000 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.231265 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.231265 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.231266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.231392 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:45.231456 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:45.231701 (+ 245us) server_negotiation.cc:299] Negotiation successful
0810 14:48:45.231789 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:48:45.232091 23849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.223609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45869 (local address 127.19.29.194:46639)
0810 14:48:45.223789 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:45.223829 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:45.224370 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:45.224582 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:45.224585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:45.225129 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:45.225331 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.225336 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.225999 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.226000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.226802 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.226805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.227191 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.227193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.227311 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.227737 (+ 426us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:45.227745 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:45.229072 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:45.230613 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.230622 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.230624 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.230867 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.231083 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.231084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.231085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.231203 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.231448 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:45.231451 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:45.231587 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 14:48:45.231702 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 14:48:45.231831 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":95,"threads_started":1}
I20260810 14:48:45.232568 23846 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45869
I20260810 14:48:45.232656 23846 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:45.232821 23846 heartbeater.cc:511] Master 127.19.29.254:45869 requested a full tablet report, sending...
I20260810 14:48:45.233213 23318 ts_manager.cc:194] Registered new tserver with Master: 6b16cd3db0b446febbc86a80e42b45d3 (127.19.29.194:34287)
I20260810 14:48:45.233709 23318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:46639
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:45.254783 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:35193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:45.333811 23853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:45.334090 23853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:45.334116 23853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:45.335330 23853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:45.335371 23853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:45.335397 23853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:45.336822 23853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:35193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45869
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:45.337044 23853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:45.337260 23853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:45.342106 23859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.342130 23864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:45.342144 23860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:45.342260 23853 server_base.cc:1034] running on GCE node
I20260810 14:48:45.342484 23853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:45.342724 23853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:45.343886 23853 hybrid_clock.cc:648] HybridClock initialized: now 1786373325343874 us; error 31 us; skew 500 ppm
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:45.346328 23853 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:45.346725 23853 webserver.cc:460] Webserver started at http://127.19.29.195:44279/ using document root <none> and password file <none>
I20260810 14:48:45.346932 23853 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:45.346990 23853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:45.347113 23853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:45.348124 23853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "090cc5601f844333946e8f3571399a69"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "6c7f8cff7cd4a21e42b50e334e74d79b"
server_key_iv: "d08f67a136f675f2d3233d47e0d488b4"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.348464 23853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "090cc5601f844333946e8f3571399a69"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "6c7f8cff7cd4a21e42b50e334e74d79b"
server_key_iv: "d08f67a136f675f2d3233d47e0d488b4"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.349757 23853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:45.350497 23875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.350715 23853 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:45.350806 23853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "090cc5601f844333946e8f3571399a69"
format_stamp: "Formatted at 2026-08-10 14:48:45 on dist-test-slave-4tdj"
server_key: "6c7f8cff7cd4a21e42b50e334e74d79b"
server_key_iv: "d08f67a136f675f2d3233d47e0d488b4"
server_key_version: "encryptionkey@0"
I20260810 14:48:45.350874 23853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:45.361835 23853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:45.363791 23853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:45.363917 23853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:45.364110 23853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:45.364378 23853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:45.364411 23853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.364439 23853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:45.364462 23853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:45.369897 23853 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:37387
I20260810 14:48:45.369976 24054 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:37387 every 8 connection(s)
I20260810 14:48:45.370236 23853 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[23242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373325, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:45.378748 23378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.370939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:48553 (local address 127.19.29.254:45869)
0810 14:48:45.371006 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:45.371008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:45.371170 (+ 162us) server_negotiation.cc:407] Connection header received
0810 14:48:45.371674 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:45.371676 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:45.371688 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:45.371750 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:45.372594 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.373105 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.374078 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.374268 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.374380 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.376337 (+ 1957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:45.376338 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:45.376338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:45.376345 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:45.377558 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.377887 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.377887 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.377887 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.377932 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:45.378213 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:45.378214 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:45.378214 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:45.378334 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:45.378387 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:45.378627 (+ 240us) server_negotiation.cc:299] Negotiation successful
0810 14:48:45.378683 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 14:48:45.378948 24063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:45.370888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45869 (local address 127.19.29.195:48553)
0810 14:48:45.371045 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:45.371084 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:45.371581 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:45.371799 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:45.371802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:45.372329 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:45.372511 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.372516 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.373192 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.373193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.373989 (+ 796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:45.373992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:45.374403 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:45.374404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:45.374533 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:45.374951 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:45.374959 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:45.376239 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:45.377626 (+ 1387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.377632 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.377634 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.377831 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.378028 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:45.378030 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:45.378030 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:45.378143 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:45.378385 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:45.378389 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:45.378496 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 14:48:45.378605 (+ 109us) client_negotiation.cc:240] Negotiation successful
0810 14:48:45.378757 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":88,"threads_started":1}
I20260810 14:48:45.379348 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23853
I20260810 14:48:45.379412 24055 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45869
I20260810 14:48:45.379446 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:45.379504 24055 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:45.379626 19575 external_mini_cluster.cc:1428] Setting key 4655a6d556fe8834689f2419645efdb1
I20260810 14:48:45.379700 24055 heartbeater.cc:511] Master 127.19.29.254:45869 requested a full tablet report, sending...
I20260810 14:48:45.380097 23318 ts_manager.cc:194] Registered new tserver with Master: 090cc5601f844333946e8f3571399a69 (127.19.29.195:37387)
I20260810 14:48:45.380496 23318 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:48553
I20260810 14:48:45.380540 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:48:45.392524 23378 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:45.391852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56290 (local address 127.19.29.254:45869)
0810 14:48:45.391893 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:45.391895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:45.391935 (+ 40us) server_negotiation.cc:407] Connection header received
0810 14:48:45.391989 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:45.391990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:45.391998 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:45.392053 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:45.392472 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56290: BlockingRecv error: recv got EOF from 127.0.0.1:56290 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:48:45.393385 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23417
I20260810 14:48:45.406061 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23641
I20260810 14:48:45.413645 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23853
I20260810 14:48:45.432883 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23262
2026-08-10T14:48:45Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1968 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[24080](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[24080](info): set up 2 sockets
Aug 10 14:48:45 dist-test-slave-4tdj krb5kdc[24080](info): commencing operation
krb5kdc: starting...
W20260810 14:48:46.680140 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260810 14:48:46.854866 19575 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.175s user 0.000s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260810 14:48:47.115877 19575 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.261s user 0.000s sys 0.002s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260810 14:48:47.338133 19575 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.222s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/test-user.keytab.
W20260810 14:48:47.724886 19575 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.387s user 0.000s sys 0.002s
Aug 10 14:48:47 dist-test-slave-4tdj krb5kdc[24080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373327, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
W20260810 14:48:48.125339 19575 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.19.29.254: real 0.379s user 0.000s sys 0.003s
I20260810 14:48:48.125687 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:33427
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39789
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:33427
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:48.205226 24099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:48.205403 24099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:48.205423 24099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:48.206525 24099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:48.206557 24099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:48.206570 24099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:48.206581 24099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:48.206591 24099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:48.208000 24099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39789
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:33427
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:33427
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24099
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:48.208184 24099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:48.208343 24099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:48.212908 24107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:48.212921 24112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:48.213032 24099 server_base.cc:1034] running on GCE node
W20260810 14:48:48.212926 24106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:48.213406 24099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:48.213689 24099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:48.214835 24099 hybrid_clock.cc:648] HybridClock initialized: now 1786373328214819 us; error 27 us; skew 500 ppm
Aug 10 14:48:48 dist-test-slave-4tdj krb5kdc[24080](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373328, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:48.222050 24099 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:48.222486 24099 webserver.cc:460] Webserver started at http://127.19.29.254:36327/ using document root <none> and password file <none>
I20260810 14:48:48.222700 24099 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:48.222749 24099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:48.222872 24099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:48.223850 24099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "1c6545a761c54c7186fae2efd706c638"
format_stamp: "Formatted at 2026-08-10 14:48:48 on dist-test-slave-4tdj"
server_key: "04399e471f0fc10c1441152e25a120d5"
server_key_iv: "6fd85d2a36cfa2ee67501e9e3a8c00bc"
server_key_version: "encryptionkey@0"
I20260810 14:48:48.224184 24099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "1c6545a761c54c7186fae2efd706c638"
format_stamp: "Formatted at 2026-08-10 14:48:48 on dist-test-slave-4tdj"
server_key: "04399e471f0fc10c1441152e25a120d5"
server_key_iv: "6fd85d2a36cfa2ee67501e9e3a8c00bc"
server_key_version: "encryptionkey@0"
I20260810 14:48:48.225383 24099 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:48.225982 24127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:48.226115 24099 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:48.226188 24099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "1c6545a761c54c7186fae2efd706c638"
format_stamp: "Formatted at 2026-08-10 14:48:48 on dist-test-slave-4tdj"
server_key: "04399e471f0fc10c1441152e25a120d5"
server_key_iv: "6fd85d2a36cfa2ee67501e9e3a8c00bc"
server_key_version: "encryptionkey@0"
I20260810 14:48:48.226251 24099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:48.241925 24099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:48.243949 24099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:48.244091 24099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:48.247812 24099 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:33427
I20260810 14:48:48.247853 24213 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:33427 every 8 connection(s)
I20260810 14:48:48.248402 24099 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:48.249064 24214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:48.250867 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24099
I20260810 14:48:48.250950 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:48.251116 19575 external_mini_cluster.cc:1428] Setting key 2e13b46d3525eb263e6b3f040f8b0aff
I20260810 14:48:48.251427 24214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638: Bootstrap starting.
I20260810 14:48:48.252106 24214 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:48.252394 24214 log.cc:824] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:48.253113 24214 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638: No bootstrap required, opened a new log
I20260810 14:48:48.255229 24214 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } }
I20260810 14:48:48.255360 24214 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:48.255393 24214 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6545a761c54c7186fae2efd706c638, State: Initialized, Role: FOLLOWER
I20260810 14:48:48.255554 24214 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } }
I20260810 14:48:48.255650 24214 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:48.255692 24214 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:48.255738 24214 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:48.256361 24214 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } }
I20260810 14:48:48.256477 24214 leader_election.cc:302] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c6545a761c54c7186fae2efd706c638; no voters:
I20260810 14:48:48.256652 24214 leader_election.cc:288] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:48.256690 24222 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:48.256860 24222 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [term 1 LEADER]: Becoming Leader. State: Replica: 1c6545a761c54c7186fae2efd706c638, State: Running, Role: LEADER
I20260810 14:48:48.256912 24214 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:48.257040 24222 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } }
Aug 10 14:48:48 dist-test-slave-4tdj krb5kdc[24080](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373327, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:48.258150 24226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c6545a761c54c7186fae2efd706c638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } } }
I20260810 14:48:48.258249 24226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:48.258503 24225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c6545a761c54c7186fae2efd706c638. Latest consensus state: current_term: 1 leader_uuid: "1c6545a761c54c7186fae2efd706c638" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6545a761c54c7186fae2efd706c638" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 33427 } } }
I20260810 14:48:48.258637 24225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:48.258653 24251 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:48.259465 24251 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:48.261365 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:48.251576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41516 (local address 127.19.29.254:33427)
0810 14:48:48.251735 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:48.251743 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:48.251767 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:48:48.252181 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:48.252189 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:48.252251 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:48.252363 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:48.253085 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:48.253951 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:48.255034 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:48.255433 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:48.255529 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:48.258131 (+ 2602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:48.258136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:48.258136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:48.258149 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:48.259886 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:48.260268 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:48.260271 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:48.260271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:48.260375 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:48.260587 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:48.260589 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:48.260589 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:48.260837 (+ 248us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:48.260973 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:48.261081 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:48:48.261209 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":60,"threads_started":1}
I20260810 14:48:48.262192 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:48:48.266693 24251 catalog_manager.cc:1347] Generated new cluster ID: 443efe1228e34a2aa0d923bb80504983
I20260810 14:48:48.266750 24251 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:48.278327 24251 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:48.278859 24251 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:48.284948 24219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:48.281004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41518 (local address 127.19.29.254:33427)
0810 14:48:48.281044 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:48.281046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:48.281146 (+ 100us) server_negotiation.cc:407] Connection header received
0810 14:48:48.281196 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:48.281197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:48.281207 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:48.281282 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:48.281670 (+ 388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:48.282429 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:48.283471 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:48.283783 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:48.283850 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:48.284498 (+ 648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:48.284500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:48.284500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:48.284706 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:48.284725 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:48.284731 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:48.284792 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:48.284848 (+ 56us) server_negotiation.cc:299] Negotiation successful
0810 14:48:48.284874 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:48:48.287424 24251 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c6545a761c54c7186fae2efd706c638: Generated new TSK 0
I20260810 14:48:48.287701 24251 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:48:48.295328 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24099
2026-08-10T14:48:48Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2863 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:48 dist-test-slave-4tdj krb5kdc[24276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:48 dist-test-slave-4tdj krb5kdc[24276](info): set up 2 sockets
Aug 10 14:48:48 dist-test-slave-4tdj krb5kdc[24276](info): commencing operation
krb5kdc: starting...
W20260810 14:48:49.452569 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.131s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:49.569047 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44697
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:44697
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:49.648034 24300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:49.648227 24300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:49.648247 24300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:49.649312 24300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:49.649343 24300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:49.649355 24300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:49.649366 24300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:49.649380 24300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:49.650877 24300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:44697
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44697
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:49.651079 24300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:49.651252 24300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:49.655833 24308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:49.655923 24312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.656001 24300 server_base.cc:1034] running on GCE node
W20260810 14:48:49.656038 24314 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.656296 24300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:49.656574 24300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:49.657724 24300 hybrid_clock.cc:648] HybridClock initialized: now 1786373329657709 us; error 29 us; skew 500 ppm
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:49.660094 24300 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:49.660506 24300 webserver.cc:460] Webserver started at http://127.19.29.254:34877/ using document root <none> and password file <none>
I20260810 14:48:49.660710 24300 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:49.660751 24300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:49.660836 24300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:49.661813 24300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "2b5a46feb56d40e09999d73d2f5784b5"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "45adbc49a0169ad9f3cd59434e3c5196"
server_key_iv: "8c36f31d4455953a5d82ad0d8ab89037"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.662101 24300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "2b5a46feb56d40e09999d73d2f5784b5"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "45adbc49a0169ad9f3cd59434e3c5196"
server_key_iv: "8c36f31d4455953a5d82ad0d8ab89037"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.663352 24300 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 14:48:49.664055 24325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.664222 24300 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:49.664312 24300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "2b5a46feb56d40e09999d73d2f5784b5"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "45adbc49a0169ad9f3cd59434e3c5196"
server_key_iv: "8c36f31d4455953a5d82ad0d8ab89037"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.664366 24300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:49.679672 24300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:49.681286 24300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:49.681389 24300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:49.685236 24300 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:44697
I20260810 14:48:49.685266 24416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:44697 every 8 connection(s)
I20260810 14:48:49.685571 24300 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:49.686731 24418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:49.688884 24418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: Bootstrap starting.
I20260810 14:48:49.689419 24418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:49.689643 24418 log.cc:824] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:49.690361 24418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: No bootstrap required, opened a new log
I20260810 14:48:49.691926 24418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } }
I20260810 14:48:49.692072 24418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:49.692101 24418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2b5a46feb56d40e09999d73d2f5784b5, State: Initialized, Role: FOLLOWER
I20260810 14:48:49.692205 24418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } }
I20260810 14:48:49.692255 24418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:49.692273 24418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:49.692303 24418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:49.693028 24418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } }
I20260810 14:48:49.693115 24418 leader_election.cc:302] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2b5a46feb56d40e09999d73d2f5784b5; no voters:
I20260810 14:48:49.693235 24418 leader_election.cc:288] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:49.693276 24422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:49.693424 24422 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [term 1 LEADER]: Becoming Leader. State: Replica: 2b5a46feb56d40e09999d73d2f5784b5, State: Running, Role: LEADER
I20260810 14:48:49.693423 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24300
I20260810 14:48:49.693490 24418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:49.693529 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:49.693562 24422 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } }
I20260810 14:48:49.693729 19575 external_mini_cluster.cc:1428] Setting key 6f8796638a3cb0f3d9e7736964167bbc
I20260810 14:48:49.693894 24422 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2b5a46feb56d40e09999d73d2f5784b5. Latest consensus state: current_term: 1 leader_uuid: "2b5a46feb56d40e09999d73d2f5784b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } } }
I20260810 14:48:49.694130 24422 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:49.694064 24428 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2b5a46feb56d40e09999d73d2f5784b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2b5a46feb56d40e09999d73d2f5784b5" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44697 } } }
I20260810 14:48:49.694412 24428 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5 [sys.catalog]: This master's current role is: LEADER
W20260810 14:48:49.695464 24458 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:48:49.695520 24458 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:48:49.695566 24443 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:49.695750 24443 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:49.697049 24443 catalog_manager.cc:1347] Generated new cluster ID: f663f824a1b24e4c86b8cfc83d796fee
I20260810 14:48:49.697108 24443 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:49.705049 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:49.694335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56992 (local address 127.19.29.254:44697)
0810 14:48:49.694504 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:49.694513 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:49.694550 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:48:49.694673 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:49.694681 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:49.694751 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:49.694924 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:49.695740 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.697108 (+ 1368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.698201 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.698855 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.698963 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:49.701600 (+ 2637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:49.701604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:49.701604 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:49.701617 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:49.703450 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:49.703857 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:49.703860 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:49.703861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:49.703968 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:49.704162 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:49.704163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:49.704163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:49.704433 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:49.704577 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:49.704701 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 14:48:49.704831 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":67,"threads_started":1}
I20260810 14:48:49.710144 24443 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:49.710649 24443 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:49.714733 24443 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2b5a46feb56d40e09999d73d2f5784b5: Generated new TSK 0
I20260810 14:48:49.714888 24443 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:49.739065 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:49.818908 24472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:49.819093 24472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:49.819115 24472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:49.820211 24472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:49.820250 24472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:49.820276 24472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:49.821703 24472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:49.821913 24472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:49.822124 24472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:49.826886 24479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:49.826853 24481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.827024 24472 server_base.cc:1034] running on GCE node
W20260810 14:48:49.826870 24485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.827276 24472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:49.827461 24472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:49.828589 24472 hybrid_clock.cc:648] HybridClock initialized: now 1786373329828578 us; error 28 us; skew 500 ppm
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:49.830931 24472 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:49.831333 24472 webserver.cc:460] Webserver started at http://127.19.29.193:39729/ using document root <none> and password file <none>
I20260810 14:48:49.831532 24472 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:49.831574 24472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:49.831712 24472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:49.832679 24472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "0dad84942c654a0d8a5add5320fc91f0"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "aca96ace417bb0b1b392dfa01ff2c3be"
server_key_iv: "28da13e008ec9ee019f9201680967775"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.832994 24472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "0dad84942c654a0d8a5add5320fc91f0"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "aca96ace417bb0b1b392dfa01ff2c3be"
server_key_iv: "28da13e008ec9ee019f9201680967775"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.834199 24472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:49.834892 24498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.835038 24472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.835119 24472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "0dad84942c654a0d8a5add5320fc91f0"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "aca96ace417bb0b1b392dfa01ff2c3be"
server_key_iv: "28da13e008ec9ee019f9201680967775"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.835181 24472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:49.849347 24472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:49.851023 24472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:49.851191 24472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:49.851389 24472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:49.851676 24472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:49.851727 24472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.851753 24472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:49.851778 24472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.857144 24472 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:46581
I20260810 14:48:49.857208 24690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:46581 every 8 connection(s)
I20260810 14:48:49.857473 24472 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:49.863615 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24472
I20260810 14:48:49.863724 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:49.863914 19575 external_mini_cluster.cc:1428] Setting key 868340e46b519a9b99b8f58a35d8e994
I20260810 14:48:49.866036 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:49.858141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:35223 (local address 127.19.29.254:44697)
0810 14:48:49.858192 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:49.858194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:49.858365 (+ 171us) server_negotiation.cc:407] Connection header received
0810 14:48:49.858858 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:49.858859 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:49.858873 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:49.858911 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:49.859797 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.860281 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.861277 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.861468 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.861511 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:49.863471 (+ 1960us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:49.863472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:49.863473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:49.863479 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:49.864799 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:49.865155 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:49.865156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:49.865157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:49.865229 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:49.865439 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:49.865440 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:49.865440 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:49.865548 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:49.865603 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:49.865861 (+ 258us) server_negotiation.cc:299] Negotiation successful
0810 14:48:49.865949 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:48:49.866175 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:49.858061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44697 (local address 127.19.29.193:35223)
0810 14:48:49.858234 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:49.858270 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:49.858766 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:49.858977 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:49.858980 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:49.859550 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:49.859730 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:49.859735 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.860359 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.860360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:49.861215 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:49.861218 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:49.861543 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:49.861544 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:49.861651 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:49.862036 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:49.862044 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:49.863377 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:49.864875 (+ 1498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:49.864882 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:49.864884 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:49.865090 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:49.865283 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:49.865284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:49.865284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:49.865384 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:49.865602 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:49.865609 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:49.865745 (+ 136us) client_negotiation.cc:769] Sending connection context
0810 14:48:49.865830 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:48:49.865975 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260810 14:48:49.866678 24691 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44697
I20260810 14:48:49.866763 24691 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:49.866942 24691 heartbeater.cc:511] Master 127.19.29.254:44697 requested a full tablet report, sending...
I20260810 14:48:49.867431 24356 ts_manager.cc:194] Registered new tserver with Master: 0dad84942c654a0d8a5add5320fc91f0 (127.19.29.193:46581)
I20260810 14:48:49.868019 24356 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:35223
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:49.888345 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:49.968118 24704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:49.968304 24704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:49.968326 24704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:49.969414 24704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:49.969455 24704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:49.969491 24704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:49.970930 24704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:49.971140 24704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:49.971344 24704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:49.975951 24711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.976060 24704 server_base.cc:1034] running on GCE node
W20260810 14:48:49.976003 24712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:49.976022 24715 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:49.976377 24704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:49.976614 24704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:49.977767 24704 hybrid_clock.cc:648] HybridClock initialized: now 1786373329977758 us; error 30 us; skew 500 ppm
Aug 10 14:48:49 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:49.980132 24704 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:49.980561 24704 webserver.cc:460] Webserver started at http://127.19.29.194:37211/ using document root <none> and password file <none>
I20260810 14:48:49.980782 24704 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:49.980829 24704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:49.980948 24704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:49.981906 24704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "b0b37f8668364677a23bd74648749630"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "a9841ee00173cbb5c9cce48f25d8182e"
server_key_iv: "f843c2877282ce507490e7f298b6da6d"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.982249 24704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "b0b37f8668364677a23bd74648749630"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "a9841ee00173cbb5c9cce48f25d8182e"
server_key_iv: "f843c2877282ce507490e7f298b6da6d"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.983492 24704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:49.984138 24722 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.984288 24704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:49.984372 24704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "b0b37f8668364677a23bd74648749630"
format_stamp: "Formatted at 2026-08-10 14:48:49 on dist-test-slave-4tdj"
server_key: "a9841ee00173cbb5c9cce48f25d8182e"
server_key_iv: "f843c2877282ce507490e7f298b6da6d"
server_key_version: "encryptionkey@0"
I20260810 14:48:49.984433 24704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:49.992137 24704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:49.993734 24704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:49.993855 24704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:49.994053 24704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:49.994433 24704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:49.994472 24704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:49.994498 24704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:49.994515 24704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:50.000195 24704 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:43641
I20260810 14:48:50.000248 24909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:43641 every 8 connection(s)
I20260810 14:48:50.000545 24704 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:50.002506 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24704
I20260810 14:48:50.002590 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:50.002739 19575 external_mini_cluster.cc:1428] Setting key 83ae34ca2b59e19fe3e6cea50ff23204
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[24276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373329, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:50.010524 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:50.001248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:52069 (local address 127.19.29.254:44697)
0810 14:48:50.001332 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:50.001334 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:50.001469 (+ 135us) server_negotiation.cc:407] Connection header received
0810 14:48:50.001985 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:50.001987 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:50.002002 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:50.002048 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:50.003357 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.004007 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.005089 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.005349 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.005405 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:50.007829 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:50.007830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:50.007831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:50.007839 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:50.009228 (+ 1389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.009612 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.009613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.009613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.009668 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.009884 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.009884 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.009885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.009996 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:50.010060 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:50.010331 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 14:48:50.010430 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260810 14:48:50.010725 24912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:50.001163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44697 (local address 127.19.29.194:52069)
0810 14:48:50.001342 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:50.001390 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:50.001885 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:50.002215 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:50.002219 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:50.002961 (+ 742us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:50.003233 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:50.003240 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.004128 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.004129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:50.004986 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:50.004989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.005425 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.005426 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:50.005576 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:50.006066 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:50.006077 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:50.007738 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:50.009311 (+ 1573us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:50.009319 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:50.009321 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:50.009537 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:50.009723 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:50.009724 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:50.009724 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:50.009830 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:50.010048 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:50.010055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:50.010192 (+ 137us) client_negotiation.cc:769] Sending connection context
0810 14:48:50.010325 (+ 133us) client_negotiation.cc:240] Negotiation successful
0810 14:48:50.010485 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260810 14:48:50.011175 24910 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44697
I20260810 14:48:50.011267 24910 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:50.011440 24910 heartbeater.cc:511] Master 127.19.29.254:44697 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
I20260810 14:48:50.011796 24356 ts_manager.cc:194] Registered new tserver with Master: b0b37f8668364677a23bd74648749630 (127.19.29.194:43641)
I20260810 14:48:50.012168 24356 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:52069
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:50.028692 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:50.109670 24915 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:50.109869 24915 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:50.109894 24915 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:50.111035 24915 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:50.111089 24915 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:50.111117 24915 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:50.112534 24915 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44697
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:50.112737 24915 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:50.112926 24915 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:50.117825 24924 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:50.117830 24931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:50.117913 24915 server_base.cc:1034] running on GCE node
W20260810 14:48:50.117811 24923 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:50.118204 24915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:50.118482 24915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:50.119642 24915 hybrid_clock.cc:648] HybridClock initialized: now 1786373330119628 us; error 33 us; skew 500 ppm
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373330, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:50.122087 24915 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:50.122548 24915 webserver.cc:460] Webserver started at http://127.19.29.195:42319/ using document root <none> and password file <none>
I20260810 14:48:50.122771 24915 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:50.122822 24915 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:50.122961 24915 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:50.123983 24915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "73ab3feb9afe4dc3bf60ae655e810c65"
format_stamp: "Formatted at 2026-08-10 14:48:50 on dist-test-slave-4tdj"
server_key: "360aa2cb73d82d2744904bddf5267344"
server_key_iv: "9fe0d9dd42c26fba0817e5d63c8bd795"
server_key_version: "encryptionkey@0"
I20260810 14:48:50.124323 24915 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "73ab3feb9afe4dc3bf60ae655e810c65"
format_stamp: "Formatted at 2026-08-10 14:48:50 on dist-test-slave-4tdj"
server_key: "360aa2cb73d82d2744904bddf5267344"
server_key_iv: "9fe0d9dd42c26fba0817e5d63c8bd795"
server_key_version: "encryptionkey@0"
I20260810 14:48:50.125608 24915 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:50.126350 24942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:50.126494 24915 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:50.126585 24915 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "73ab3feb9afe4dc3bf60ae655e810c65"
format_stamp: "Formatted at 2026-08-10 14:48:50 on dist-test-slave-4tdj"
server_key: "360aa2cb73d82d2744904bddf5267344"
server_key_iv: "9fe0d9dd42c26fba0817e5d63c8bd795"
server_key_version: "encryptionkey@0"
I20260810 14:48:50.126654 24915 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:50.149271 24915 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:50.151306 24915 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:50.151448 24915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:50.151724 24915 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:50.152069 24915 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:50.152107 24915 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:50.152135 24915 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:50.152153 24915 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:50.157575 24915 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:41187
I20260810 14:48:50.157631 25116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:41187 every 8 connection(s)
I20260810 14:48:50.157927 24915 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[24276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373330, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:50.163785 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24915
I20260810 14:48:50.163872 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:50.164076 19575 external_mini_cluster.cc:1428] Setting key 1c2088e159f2070d6eba61f7df0c596e
I20260810 14:48:50.166539 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:50.158628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:48629 (local address 127.19.29.254:44697)
0810 14:48:50.158682 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:50.158684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:50.158902 (+ 218us) server_negotiation.cc:407] Connection header received
0810 14:48:50.159393 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:50.159394 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:50.159404 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:50.159454 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:50.160377 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.160877 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.161833 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.162023 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.162075 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:50.164165 (+ 2090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:50.164167 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:50.164167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:50.164175 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:50.165413 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.165754 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.165754 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.165755 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.165798 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.165957 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.165958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.165958 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.166049 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:50.166094 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:50.166394 (+ 300us) server_negotiation.cc:299] Negotiation successful
0810 14:48:50.166453 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:48:50.166723 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:50.158601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44697 (local address 127.19.29.195:48629)
0810 14:48:50.158774 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:50.158812 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:50.159313 (+ 501us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:50.159553 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:50.159556 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:50.160112 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:50.160296 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:50.160301 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.160956 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.160957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:50.161752 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:50.161754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.162083 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.162084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:50.162177 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:50.162631 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:50.162641 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:50.164077 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:50.165475 (+ 1398us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:50.165482 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:50.165483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:50.165696 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:50.165838 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:50.165838 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:50.165839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:50.165920 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:50.166123 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:50.166130 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:50.166248 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 14:48:50.166379 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 14:48:50.166515 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260810 14:48:50.167130 25117 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44697
I20260810 14:48:50.167212 25117 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:50.167351 25117 heartbeater.cc:511] Master 127.19.29.254:44697 requested a full tablet report, sending...
I20260810 14:48:50.167681 24356 ts_manager.cc:194] Registered new tserver with Master: 73ab3feb9afe4dc3bf60ae655e810c65 (127.19.29.195:41187)
I20260810 14:48:50.168077 24356 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:48629
I20260810 14:48:50.175586 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[24276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373330, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[24276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373330, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:50.198418 24444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:50.191871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57006 (local address 127.19.29.254:44697)
0810 14:48:50.191928 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:50.191929 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:50.191941 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:48:50.192011 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:50.192012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:50.192022 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:50.192083 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:50.192579 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.193168 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.193951 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:50.194174 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:50.194231 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:50.196325 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:50.196326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:50.196327 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:50.196333 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:50.197578 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.197838 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.197838 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.197839 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.197882 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:50.198011 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:50.198011 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:50.198011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:50.198137 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:50.198211 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:50.198273 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 14:48:50.198353 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
W20260810 14:48:50.198621 24356 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:57006
I20260810 14:48:50.198987 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24472
I20260810 14:48:50.209754 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24704
I20260810 14:48:50.241312 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24915
I20260810 14:48:50.259101 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24300
2026-08-10T14:48:50Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1959 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[25133](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[25133](info): set up 2 sockets
Aug 10 14:48:50 dist-test-slave-4tdj krb5kdc[25133](info): commencing operation
krb5kdc: starting...
W20260810 14:48:51.421751 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:51 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:51.532634 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34727
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:34727
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:51.616314 25157 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:51.616586 25157 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:51.616621 25157 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:51.618155 25157 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:51.618230 25157 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:51.618258 25157 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:51.618281 25157 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:51.618321 25157 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:51.620189 25157 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:34727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25157
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:51.620424 25157 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:51.620652 25157 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:51.625862 25164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:51.625916 25163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:51.625882 25168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:51.626596 25157 server_base.cc:1034] running on GCE node
I20260810 14:48:51.626894 25157 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:51.630074 25157 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:51.631286 25157 hybrid_clock.cc:648] HybridClock initialized: now 1786373331631264 us; error 34 us; skew 500 ppm
Aug 10 14:48:51 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373331, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:51.634141 25157 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:51.634663 25157 webserver.cc:460] Webserver started at http://127.19.29.254:32963/ using document root <none> and password file <none>
I20260810 14:48:51.634943 25157 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:51.635016 25157 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:51.635154 25157 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:51.636582 25157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "74fd27444da84ff7a02b2c767d21ea46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "ea04913564f04d4662cde88e29b720aa"
server_key_iv: "1de7c363a4f7692c38a23632314a2012"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.637006 25157 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "74fd27444da84ff7a02b2c767d21ea46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "ea04913564f04d4662cde88e29b720aa"
server_key_iv: "1de7c363a4f7692c38a23632314a2012"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.638687 25157 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:51.639519 25182 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:51.639711 25157 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:51.639845 25157 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "74fd27444da84ff7a02b2c767d21ea46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "ea04913564f04d4662cde88e29b720aa"
server_key_iv: "1de7c363a4f7692c38a23632314a2012"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.639927 25157 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:51.710443 25157 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:51.712244 25157 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:51.712356 25157 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:51.716267 25157 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:34727
I20260810 14:48:51.716303 25254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:34727 every 8 connection(s)
I20260810 14:48:51.716789 25157 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:51.717437 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25157
I20260810 14:48:51.717465 25255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:51.717530 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:51.717681 19575 external_mini_cluster.cc:1428] Setting key c02ebb1f4eda676c48e7c2a4039d0a80
I20260810 14:48:51.720647 25255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: Bootstrap starting.
I20260810 14:48:51.721349 25255 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:51.721616 25255 log.cc:824] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:51.722327 25255 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: No bootstrap required, opened a new log
Aug 10 14:48:51 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373331, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:51.724110 25255 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } }
I20260810 14:48:51.724253 25255 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:51.724298 25255 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74fd27444da84ff7a02b2c767d21ea46, State: Initialized, Role: FOLLOWER
I20260810 14:48:51.724422 25255 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } }
I20260810 14:48:51.724519 25255 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:51.724557 25255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:51.724607 25255 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:51.725111 25255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } }
I20260810 14:48:51.725224 25255 leader_election.cc:302] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74fd27444da84ff7a02b2c767d21ea46; no voters:
I20260810 14:48:51.725371 25255 leader_election.cc:288] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:51.725412 25261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:51.725523 25261 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [term 1 LEADER]: Becoming Leader. State: Replica: 74fd27444da84ff7a02b2c767d21ea46, State: Running, Role: LEADER
I20260810 14:48:51.725649 25255 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:51.725669 25261 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } }
I20260810 14:48:51.726110 25262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74fd27444da84ff7a02b2c767d21ea46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } } }
I20260810 14:48:51.726395 25262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:51.726280 25263 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74fd27444da84ff7a02b2c767d21ea46. Latest consensus state: current_term: 1 leader_uuid: "74fd27444da84ff7a02b2c767d21ea46" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74fd27444da84ff7a02b2c767d21ea46" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34727 } } }
I20260810 14:48:51.726658 25263 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46 [sys.catalog]: This master's current role is: LEADER
W20260810 14:48:51.727465 25287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:48:51.727510 25287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:48:51.727586 25273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:51.727739 25273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:51.728250 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:51.718175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42794 (local address 127.19.29.254:34727)
0810 14:48:51.718394 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:51.718403 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:51.718438 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:48:51.718936 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:51.718947 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:51.719024 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:51.719178 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:51.719811 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.721121 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.721881 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.722399 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.722503 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:51.724745 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:51.724749 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:51.724750 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:51.724760 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:51.726646 (+ 1886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:51.726967 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:51.726970 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:51.726970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:51.727084 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:51.727329 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:51.727330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:51.727331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:51.727645 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:51.727815 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:51.727917 (+ 102us) server_negotiation.cc:299] Negotiation successful
0810 14:48:51.728056 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":85,"threads_started":1}
I20260810 14:48:51.729185 25273 catalog_manager.cc:1347] Generated new cluster ID: 6a49a65d2594470daf3c10c476f03431
I20260810 14:48:51.729233 25273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:51.751362 25273 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:51.751871 25273 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:51.767081 25273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74fd27444da84ff7a02b2c767d21ea46: Generated new TSK 0
I20260810 14:48:51.767261 25273 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:51.797637 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:51.876658 25296 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:51.876850 25296 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:51.876880 25296 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:51.877981 25296 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:51.878021 25296 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:51.878053 25296 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:51.879559 25296 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25296
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:51.879786 25296 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:51.879981 25296 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:51.884773 25305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:51.884748 25311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:51.884883 25296 server_base.cc:1034] running on GCE node
W20260810 14:48:51.884752 25306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:51.885139 25296 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:51.885354 25296 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:51.886509 25296 hybrid_clock.cc:648] HybridClock initialized: now 1786373331886487 us; error 34 us; skew 500 ppm
Aug 10 14:48:51 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373331, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:51.888836 25296 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:51.889210 25296 webserver.cc:460] Webserver started at http://127.19.29.193:43981/ using document root <none> and password file <none>
I20260810 14:48:51.889394 25296 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:51.889432 25296 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:51.889516 25296 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:51.890472 25296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "2867f493da184d63a741992b0ba69e46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "a25382334f0b240397d30ed5d31e49f0"
server_key_iv: "0b43f794763fecdd99e61cb962155385"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.890760 25296 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "2867f493da184d63a741992b0ba69e46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "a25382334f0b240397d30ed5d31e49f0"
server_key_iv: "0b43f794763fecdd99e61cb962155385"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.891938 25296 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:51.892598 25322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:51.892747 25296 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:51.892831 25296 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "2867f493da184d63a741992b0ba69e46"
format_stamp: "Formatted at 2026-08-10 14:48:51 on dist-test-slave-4tdj"
server_key: "a25382334f0b240397d30ed5d31e49f0"
server_key_iv: "0b43f794763fecdd99e61cb962155385"
server_key_version: "encryptionkey@0"
I20260810 14:48:51.892889 25296 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:51.918068 25296 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:51.920157 25296 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:51.920296 25296 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:51.920509 25296 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:51.920801 25296 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:51.920835 25296 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:51.920863 25296 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:51.920881 25296 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:51.926587 25296 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:38939
I20260810 14:48:51.926644 25513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:38939 every 8 connection(s)
I20260810 14:48:51.926920 25296 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:48:51.932554 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25296
I20260810 14:48:51.932647 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
Aug 10 14:48:51 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373331, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:51.932845 19575 external_mini_cluster.cc:1428] Setting key 8879a81965210e29bdf924fff93463da
I20260810 14:48:51.935990 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:51.927640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:55801 (local address 127.19.29.254:34727)
0810 14:48:51.927697 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:51.927698 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:51.927883 (+ 185us) server_negotiation.cc:407] Connection header received
0810 14:48:51.928775 (+ 892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:51.928777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:51.928787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:51.928840 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:51.929387 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.929881 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.930864 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.931087 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.931146 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:51.933185 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:51.933187 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:51.933187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:51.933195 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:51.934647 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:51.935100 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:51.935101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:51.935101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:51.935174 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:51.935408 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:51.935408 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:51.935409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:51.935537 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:51.935628 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:51.935813 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 14:48:51.935900 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:48:51.936048 25518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:51.927608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34727 (local address 127.19.29.193:55801)
0810 14:48:51.927770 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:51.927809 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:51.928675 (+ 866us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:51.928898 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:51.928901 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:51.929129 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:51.929306 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:51.929311 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.929945 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.929946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:51.930791 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:51.930793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:51.931197 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:51.931198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:51.931310 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:51.931693 (+ 383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:51.931701 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:51.933095 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:51.934725 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:51.934733 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:51.934735 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:51.935015 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:51.935245 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:51.935246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:51.935246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:51.935354 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:51.935595 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:51.935599 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:51.935706 (+ 107us) client_negotiation.cc:769] Sending connection context
0810 14:48:51.935782 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:48:51.935896 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260810 14:48:51.936517 25514 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34727
I20260810 14:48:51.936605 25514 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:51.936857 25514 heartbeater.cc:511] Master 127.19.29.254:34727 requested a full tablet report, sending...
I20260810 14:48:51.937414 25207 ts_manager.cc:194] Registered new tserver with Master: 2867f493da184d63a741992b0ba69e46 (127.19.29.193:38939)
I20260810 14:48:51.938335 25207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:55801
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:51.956655 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:52.036041 25523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:52.036233 25523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:52.036262 25523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:52.037388 25523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:52.037425 25523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:52.037459 25523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:52.038923 25523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:52.039155 25523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:52.039350 25523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:52.043999 25528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:52.044010 25529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:52.044054 25523 server_base.cc:1034] running on GCE node
W20260810 14:48:52.043999 25532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:52.044443 25523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:52.044684 25523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:52.045817 25523 hybrid_clock.cc:648] HybridClock initialized: now 1786373332045805 us; error 28 us; skew 500 ppm
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:52.048128 25523 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:52.048527 25523 webserver.cc:460] Webserver started at http://127.19.29.194:34847/ using document root <none> and password file <none>
I20260810 14:48:52.048732 25523 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:52.048779 25523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:52.048900 25523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:52.049858 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "8c3fea2b51d14163a530fc328c13aae2"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "07db60b6720d2264dfab5ed16dd5ef57"
server_key_iv: "90d5b3a84c5e29e5048519f70b00c6e6"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.050168 25523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "8c3fea2b51d14163a530fc328c13aae2"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "07db60b6720d2264dfab5ed16dd5ef57"
server_key_iv: "90d5b3a84c5e29e5048519f70b00c6e6"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.051379 25523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:52.052014 25546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.052161 25523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:52.052242 25523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "8c3fea2b51d14163a530fc328c13aae2"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "07db60b6720d2264dfab5ed16dd5ef57"
server_key_iv: "90d5b3a84c5e29e5048519f70b00c6e6"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.052299 25523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:52.061349 25523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:52.063263 25523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:52.063395 25523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:52.064492 25523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:52.064795 25523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:52.064828 25523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.064855 25523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:52.064872 25523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.070278 25523 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34399
I20260810 14:48:52.070374 25717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34399 every 8 connection(s)
I20260810 14:48:52.070650 25523 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:52.071048 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25523
I20260810 14:48:52.071156 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:52.071355 19575 external_mini_cluster.cc:1428] Setting key 2df14a9c5827084ef58174fb47ffc57d
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
I20260810 14:48:52.079875 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.071343 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:34105 (local address 127.19.29.254:34727)
0810 14:48:52.071393 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:52.071395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:52.071704 (+ 309us) server_negotiation.cc:407] Connection header received
0810 14:48:52.072605 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:52.072606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:52.072618 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:52.072664 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:52.073273 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.073770 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.074754 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.074958 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.075013 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.077287 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:52.077288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:52.077288 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:52.077296 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:52.078576 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.079012 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.079013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.079013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.079058 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.079308 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.079309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.079309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.079400 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:52.079442 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:52.079737 (+ 295us) server_negotiation.cc:299] Negotiation successful
0810 14:48:52.079803 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:48:52.080127 25722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.071334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34727 (local address 127.19.29.194:34105)
0810 14:48:52.071568 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:52.071614 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:52.072495 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:52.072747 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:52.072751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:52.072995 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:52.073182 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:52.073186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.073848 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.073849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:52.074669 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:52.074671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.075026 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.075027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:52.075150 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.075638 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:52.075646 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:52.077197 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:52.078649 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:52.078656 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:52.078659 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:52.078934 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:52.079117 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:52.079118 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:52.079118 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:52.079249 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:52.079452 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:52.079458 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:52.079616 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 14:48:52.079726 (+ 110us) client_negotiation.cc:240] Negotiation successful
0810 14:48:52.079897 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":74,"threads_started":1}
I20260810 14:48:52.080650 25718 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34727
I20260810 14:48:52.080744 25718 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:52.080968 25718 heartbeater.cc:511] Master 127.19.29.254:34727 requested a full tablet report, sending...
I20260810 14:48:52.081336 25207 ts_manager.cc:194] Registered new tserver with Master: 8c3fea2b51d14163a530fc328c13aae2 (127.19.29.194:34399)
I20260810 14:48:52.081696 25207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:34105
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:52.095175 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36549
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:52.174943 25726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:52.175132 25726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:52.175154 25726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:52.176259 25726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:52.176298 25726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:52.176323 25726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:52.177798 25726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36549
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34727
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25726
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:52.178017 25726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:52.178229 25726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:52.183030 25734 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:52.183076 25726 server_base.cc:1034] running on GCE node
W20260810 14:48:52.183068 25737 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:52.183044 25739 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:52.183434 25726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:52.183682 25726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:52.184847 25726 hybrid_clock.cc:648] HybridClock initialized: now 1786373332184835 us; error 27 us; skew 500 ppm
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:52.187249 25726 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:52.187640 25726 webserver.cc:460] Webserver started at http://127.19.29.195:45029/ using document root <none> and password file <none>
I20260810 14:48:52.187825 25726 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:52.187862 25726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:52.187956 25726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:52.188881 25726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "2da58e22bbb94555b2999e4302b3e3ee"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "a7a7b9a81f97927ca40ba92e7cb7118c"
server_key_iv: "14a90070d99f92cc67063923f3c62955"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.189162 25726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "2da58e22bbb94555b2999e4302b3e3ee"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "a7a7b9a81f97927ca40ba92e7cb7118c"
server_key_iv: "14a90070d99f92cc67063923f3c62955"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.190413 25726 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:52.191085 25750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.191249 25726 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.191336 25726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "2da58e22bbb94555b2999e4302b3e3ee"
format_stamp: "Formatted at 2026-08-10 14:48:52 on dist-test-slave-4tdj"
server_key: "a7a7b9a81f97927ca40ba92e7cb7118c"
server_key_iv: "14a90070d99f92cc67063923f3c62955"
server_key_version: "encryptionkey@0"
I20260810 14:48:52.191395 25726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:52.213428 25726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:52.215284 25726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:52.215391 25726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:52.215572 25726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:52.215811 25726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:52.215840 25726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.215860 25726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:52.215874 25726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:52.221262 25726 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:32951
I20260810 14:48:52.221303 25944 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:32951 every 8 connection(s)
I20260810 14:48:52.221583 25726 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:52.229924 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25726
I20260810 14:48:52.230018 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:52.230145 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.222237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:49565 (local address 127.19.29.254:34727)
0810 14:48:52.222321 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:52.222323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:52.222489 (+ 166us) server_negotiation.cc:407] Connection header received
0810 14:48:52.223357 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:52.223358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:52.223369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:52.223416 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:52.223949 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.224444 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.225425 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.225636 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.225693 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.227785 (+ 2092us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:52.227786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:52.227786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:52.227793 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:52.228900 (+ 1107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.229253 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.229254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.229255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.229311 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.229516 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.229517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.229517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.229626 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:52.229679 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:52.229977 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 14:48:52.230069 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:52.230186 19575 external_mini_cluster.cc:1428] Setting key 8d8d938235bdb8568e218304569d3ba6
I20260810 14:48:52.230342 25947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.222205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34727 (local address 127.19.29.195:49565)
0810 14:48:52.222375 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:52.222411 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:52.223267 (+ 856us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:52.223476 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:52.223479 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:52.223711 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:52.223888 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:52.223892 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.224510 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.224510 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:52.225362 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:52.225364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.225694 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.225695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:52.225814 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.226247 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:52.226257 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:52.227701 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:52.228970 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:52.228978 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:52.228980 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:52.229190 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:52.229362 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:52.229363 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:52.229363 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:52.229456 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:52.229679 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:52.229685 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:52.229828 (+ 143us) client_negotiation.cc:769] Sending connection context
0810 14:48:52.229942 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 14:48:52.230109 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":97,"threads_started":1}
I20260810 14:48:52.230711 25945 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34727
I20260810 14:48:52.230808 25945 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:52.230971 25945 heartbeater.cc:511] Master 127.19.29.254:34727 requested a full tablet report, sending...
I20260810 14:48:52.231312 25207 ts_manager.cc:194] Registered new tserver with Master: 2da58e22bbb94555b2999e4302b3e3ee (127.19.29.195:32951)
I20260810 14:48:52.231688 25207 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:49565
I20260810 14:48:52.241771 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:52.264283 25954 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.257312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33468 (local address 127.19.29.193:38939)
0810 14:48:52.257484 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:52.257490 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:52.257505 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:48:52.257530 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:52.257532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:52.257546 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:52.257606 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:52.258127 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.258905 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.259606 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.259908 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.259957 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.261939 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:52.261947 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:52.261948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:52.261954 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:52.263324 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.263648 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.263651 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.263652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.263712 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.263844 (+ 132us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.263844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.263845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.263963 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:52.264067 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:52.264131 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 14:48:52.264192 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25133](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373332, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:52.271626 25259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:52.265469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.19.29.254:34727)
0810 14:48:52.265533 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:52.265535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:52.265569 (+ 34us) server_negotiation.cc:407] Connection header received
0810 14:48:52.265594 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:52.265594 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:52.265604 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:52.265647 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:52.266054 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.266584 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.267281 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:52.267494 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:52.267553 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:52.269423 (+ 1870us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:52.269424 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:52.269424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:52.269431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:52.270653 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.270933 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.270934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.270934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.270986 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:52.271142 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:52.271143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:52.271144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:52.271285 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:52.271368 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:52.271463 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 14:48:52.271534 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
W20260810 14:48:52.271840 25207 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42798
I20260810 14:48:52.272130 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25296
I20260810 14:48:52.288161 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25523
I20260810 14:48:52.298151 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25726
I20260810 14:48:52.304977 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25157
2026-08-10T14:48:52Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2045 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25962](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25962](info): set up 2 sockets
Aug 10 14:48:52 dist-test-slave-4tdj krb5kdc[25962](info): commencing operation
krb5kdc: starting...
W20260810 14:48:53.454965 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:53 dist-test-slave-4tdj krb5kdc[25962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:53.569353 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45459
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45459
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:53.650147 25979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:53.650374 25979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:53.650404 25979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:53.651512 25979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:53.651546 25979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:53.651557 25979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:53.651569 25979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:53.651582 25979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:53.653020 25979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:53.653225 25979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:53.653416 25979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:48:53.657968 25979 server_base.cc:1034] running on GCE node
W20260810 14:48:53.657989 25986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:53.657925 25990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:53.657939 25995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:53.658404 25979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:53.658684 25979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:53.659875 25979 hybrid_clock.cc:648] HybridClock initialized: now 1786373333659862 us; error 29 us; skew 500 ppm
Aug 10 14:48:53 dist-test-slave-4tdj krb5kdc[25962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373333, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:53.666579 25979 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:53.666910 25979 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:53.666961 25979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:53.667089 25979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:53.668097 25979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "752eb296899a4d7b98843768bcc34e71"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "495ad8c7ce934a018f91bb2369d5347f"
server_key_iv: "50efcf75a74f0676268e4d5a05d29429"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.668422 25979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "752eb296899a4d7b98843768bcc34e71"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "495ad8c7ce934a018f91bb2369d5347f"
server_key_iv: "50efcf75a74f0676268e4d5a05d29429"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.669615 25979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:53.670347 26006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:53.670506 25979 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:48:53.670593 25979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "752eb296899a4d7b98843768bcc34e71"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "495ad8c7ce934a018f91bb2369d5347f"
server_key_iv: "50efcf75a74f0676268e4d5a05d29429"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.670656 25979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:53.690851 25979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:53.692744 25979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:53.692883 25979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:53.696779 25979 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45459
I20260810 14:48:53.696812 26083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45459 every 8 connection(s)
I20260810 14:48:53.697065 25979 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:53.698190 26084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:53.700594 26084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: Bootstrap starting.
I20260810 14:48:53.701164 26084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:53.701426 26084 log.cc:824] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:53.702119 26084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: No bootstrap required, opened a new log
I20260810 14:48:53.703714 26084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } }
I20260810 14:48:53.703874 26084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:53.703902 26084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 752eb296899a4d7b98843768bcc34e71, State: Initialized, Role: FOLLOWER
I20260810 14:48:53.703979 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25979
I20260810 14:48:53.704089 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:53.704048 26084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } }
I20260810 14:48:53.704131 26084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:53.704177 26084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:53.704231 26084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:53.704274 19575 external_mini_cluster.cc:1428] Setting key 6370f2ede4b9602ba5bb910943ff1e55
I20260810 14:48:53.705121 26084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } }
I20260810 14:48:53.705235 26084 leader_election.cc:302] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 752eb296899a4d7b98843768bcc34e71; no voters:
I20260810 14:48:53.705400 26084 leader_election.cc:288] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:53.705453 26093 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:53.705662 26093 raft_consensus.cc:686] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [term 1 LEADER]: Becoming Leader. State: Replica: 752eb296899a4d7b98843768bcc34e71, State: Running, Role: LEADER
I20260810 14:48:53.705677 26084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:53.705821 26093 consensus_queue.cc:237] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } }
I20260810 14:48:53.706221 26094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "752eb296899a4d7b98843768bcc34e71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } } }
I20260810 14:48:53.706331 26094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:53.706547 26095 sys_catalog.cc:455] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 752eb296899a4d7b98843768bcc34e71. Latest consensus state: current_term: 1 leader_uuid: "752eb296899a4d7b98843768bcc34e71" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "752eb296899a4d7b98843768bcc34e71" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45459 } } }
I20260810 14:48:53.706655 26095 sys_catalog.cc:458] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71 [sys.catalog]: This master's current role is: LEADER
W20260810 14:48:53.707620 26119 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:48:53.707684 26119 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:48:53.707744 26105 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:53.707921 26105 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:53.710688 26105 catalog_manager.cc:1347] Generated new cluster ID: aa33d1192ed5400caa5bb1eec0a1b152
I20260810 14:48:53.710742 26105 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:48:53 dist-test-slave-4tdj krb5kdc[25962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373333, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:53.715472 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:53.704754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60622 (local address 127.19.29.254:45459)
0810 14:48:53.704926 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:53.704935 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:53.705036 (+ 101us) server_negotiation.cc:407] Connection header received
0810 14:48:53.705170 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:53.705175 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:53.705244 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:53.705362 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:53.706172 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.707497 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.708328 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.708873 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.708984 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:53.711894 (+ 2910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:53.711898 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:53.711898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:53.711909 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:53.713742 (+ 1833us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:53.714161 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:53.714164 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:53.714164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:53.714277 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:53.714565 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:53.714566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:53.714566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:53.714840 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:53.714986 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:53.715152 (+ 166us) server_negotiation.cc:299] Negotiation successful
0810 14:48:53.715282 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260810 14:48:53.730149 26105 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:53.730859 26105 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:53.739974 26105 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: Generated new TSK 0
I20260810 14:48:53.740132 26105 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:53.771333 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:53.851598 26126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:53.851778 26126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:53.851811 26126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:53.852916 26126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:53.852952 26126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:53.852986 26126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:53.854517 26126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26126
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:53.854745 26126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:53.854919 26126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:53.859508 26135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:53.859510 26134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:53.859753 26126 server_base.cc:1034] running on GCE node
W20260810 14:48:53.859783 26141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:53.860014 26126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:53.860234 26126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:53.861375 26126 hybrid_clock.cc:648] HybridClock initialized: now 1786373333861361 us; error 29 us; skew 500 ppm
Aug 10 14:48:53 dist-test-slave-4tdj krb5kdc[25962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373333, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:53.863802 26126 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:53.864094 26126 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:53.864137 26126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:53.864226 26126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:53.865168 26126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "764d7cd9bfe44805907abc11b3860a3c"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "8ca477c0d67e63501252966195e53882"
server_key_iv: "30bc5485864e42c26274c30824dd9dac"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.865469 26126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "764d7cd9bfe44805907abc11b3860a3c"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "8ca477c0d67e63501252966195e53882"
server_key_iv: "30bc5485864e42c26274c30824dd9dac"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.866667 26126 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:53.867300 26151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:53.867446 26126 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:53.867518 26126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "764d7cd9bfe44805907abc11b3860a3c"
format_stamp: "Formatted at 2026-08-10 14:48:53 on dist-test-slave-4tdj"
server_key: "8ca477c0d67e63501252966195e53882"
server_key_iv: "30bc5485864e42c26274c30824dd9dac"
server_key_version: "encryptionkey@0"
I20260810 14:48:53.867583 26126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:53.889655 26126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:53.891688 26126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:53.891820 26126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:53.892025 26126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:53.892333 26126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:53.892367 26126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:53.892392 26126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:53.892409 26126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:53.897606 26126 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:46065
I20260810 14:48:53.897666 26327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:46065 every 8 connection(s)
I20260810 14:48:53.897879 26126 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:53 dist-test-slave-4tdj krb5kdc[25962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373333, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:53.906574 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:53.898564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:43429 (local address 127.19.29.254:45459)
0810 14:48:53.898623 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:53.898626 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:53.898824 (+ 198us) server_negotiation.cc:407] Connection header received
0810 14:48:53.899313 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:53.899314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:53.899331 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:53.899378 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:53.900402 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.900903 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.901851 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.902074 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.902129 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:53.904215 (+ 2086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:53.904216 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:53.904217 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:53.904223 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:53.905342 (+ 1119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:53.905753 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:53.905754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:53.905754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:53.905806 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:53.906016 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:53.906016 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:53.906016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:53.906109 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:53.906152 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:53.906409 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 14:48:53.906475 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:53.906754 26330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:53.898544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45459 (local address 127.19.29.193:43429)
0810 14:48:53.898712 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:53.898748 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:53.899220 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:53.899459 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:53.899464 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:53.899716 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:53.900304 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:53.900311 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.900984 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.900985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:53.901769 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:53.901772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:53.902145 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:53.902146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:53.902270 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:53.902723 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:53.902732 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:53.904118 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:53.905413 (+ 1295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:53.905419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:53.905421 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:53.905687 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:53.905857 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:53.905858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:53.905858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:53.905954 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:53.906153 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:53.906156 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:53.906262 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 14:48:53.906393 (+ 131us) client_negotiation.cc:240] Negotiation successful
0810 14:48:53.906530 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260810 14:48:53.906735 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 26126
I20260810 14:48:53.906840 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:53.907006 19575 external_mini_cluster.cc:1428] Setting key a68e5deafc54497a3878bc4bbfcf12a8
I20260810 14:48:53.907305 26328 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45459
I20260810 14:48:53.907407 26328 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:53.907564 26328 heartbeater.cc:511] Master 127.19.29.254:45459 requested a full tablet report, sending...
I20260810 14:48:53.908131 26031 ts_manager.cc:194] Registered new tserver with Master: 764d7cd9bfe44805907abc11b3860a3c (127.19.29.193:46065)
I20260810 14:48:53.908943 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:43429
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:53.930775 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:54.010071 26333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.010260 26333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.010282 26333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.011381 26333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.011413 26333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.011437 26333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:54.012847 26333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.013017 26333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.013185 26333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:54.017850 26340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.017876 26342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.017899 26333 server_base.cc:1034] running on GCE node
W20260810 14:48:54.017865 26344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.018258 26333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.018510 26333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.019646 26333 hybrid_clock.cc:648] HybridClock initialized: now 1786373334019645 us; error 37 us; skew 500 ppm
Aug 10 14:48:54 dist-test-slave-4tdj krb5kdc[25962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373334, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:54.021935 26333 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:54.022202 26333 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.022243 26333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.022367 26333 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.023293 26333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "10c1e29290e84205a51e57b247bb72b1"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "a437c795b5af06fe2fa5b3b5a498d550"
server_key_iv: "f0ebc4880d0d67ee79b439775914ac9d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.023586 26333 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "10c1e29290e84205a51e57b247bb72b1"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "a437c795b5af06fe2fa5b3b5a498d550"
server_key_iv: "f0ebc4880d0d67ee79b439775914ac9d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.024672 26333 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:54.025321 26359 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.025483 26333 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:54.025573 26333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "10c1e29290e84205a51e57b247bb72b1"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "a437c795b5af06fe2fa5b3b5a498d550"
server_key_iv: "f0ebc4880d0d67ee79b439775914ac9d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.025625 26333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.034181 26333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.035772 26333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.035872 26333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.036041 26333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:54.036268 26333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:54.036298 26333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.036315 26333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:54.036331 26333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.041435 26333 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:42251
I20260810 14:48:54.041496 26568 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:42251 every 8 connection(s)
I20260810 14:48:54.041692 26333 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:54.045258 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 26333
I20260810 14:48:54.045343 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:54.045528 19575 external_mini_cluster.cc:1428] Setting key 8e1dedbf9f852cd4058f999f8eb2ff7a
Aug 10 14:48:54 dist-test-slave-4tdj krb5kdc[25962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373334, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:54.050663 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.042330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:53753 (local address 127.19.29.254:45459)
0810 14:48:54.042395 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.042398 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.042561 (+ 163us) server_negotiation.cc:407] Connection header received
0810 14:48:54.043013 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.043014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.043028 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.043078 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.043921 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.044411 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.045405 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.045735 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.045814 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.048135 (+ 2321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.048136 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.048137 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:54.048145 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.049390 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.049772 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.049773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.049774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.049835 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.050041 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.050042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.050043 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.050157 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.050213 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.050492 (+ 279us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.050575 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:48:54.050822 26574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.042260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45459 (local address 127.19.29.194:53753)
0810 14:48:54.042440 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.042478 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.042918 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.043143 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.043147 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.043381 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.043827 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.043832 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.044491 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.044493 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.045296 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.045299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.045828 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.045830 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.046077 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.046560 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:54.046571 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.048030 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.049461 (+ 1431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:54.049466 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:54.049468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:54.049700 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:54.049889 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:54.049890 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:54.049890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:54.049987 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:54.050212 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.050218 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.050376 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.050464 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.050617 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":102,"threads_started":1}
I20260810 14:48:54.051352 26571 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45459
I20260810 14:48:54.051438 26571 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:54.051575 26571 heartbeater.cc:511] Master 127.19.29.254:45459 requested a full tablet report, sending...
I20260810 14:48:54.051941 26031 ts_manager.cc:194] Registered new tserver with Master: 10c1e29290e84205a51e57b247bb72b1 (127.19.29.194:42251)
I20260810 14:48:54.052423 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:53753
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:54.073333 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34315
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:54.155224 26582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.155442 26582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.155476 26582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.156589 26582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.156625 26582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.156651 26582 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:54.158172 26582 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34315
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45459
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.158413 26582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.158622 26582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:48:54.163648 26582 server_base.cc:1034] running on GCE node
W20260810 14:48:54.163569 26589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.163566 26595 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.163600 26588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.163967 26582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.164217 26582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.165354 26582 hybrid_clock.cc:648] HybridClock initialized: now 1786373334165337 us; error 34 us; skew 500 ppm
Aug 10 14:48:54 dist-test-slave-4tdj krb5kdc[25962](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373334, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:54.167780 26582 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:54.168102 26582 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.168149 26582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.168244 26582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.169211 26582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "348161808cf54437996911f79a843bf7"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "2c09baf18811cbc8bb601fa0761c0d0e"
server_key_iv: "8ae078b5c0f2132550c721b2cbe311a1"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.169502 26582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "348161808cf54437996911f79a843bf7"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "2c09baf18811cbc8bb601fa0761c0d0e"
server_key_iv: "8ae078b5c0f2132550c721b2cbe311a1"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.170799 26582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:48:54.171444 26607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.171597 26582 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.171682 26582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "348161808cf54437996911f79a843bf7"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "2c09baf18811cbc8bb601fa0761c0d0e"
server_key_iv: "8ae078b5c0f2132550c721b2cbe311a1"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.171738 26582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.182907 26582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.184882 26582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.184988 26582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.185171 26582 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:54.185431 26582 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:54.185461 26582 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.185480 26582 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:54.185490 26582 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.190871 26582 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:43185
I20260810 14:48:54.190909 26795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:43185 every 8 connection(s)
I20260810 14:48:54.191149 26582 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:48:54 dist-test-slave-4tdj krb5kdc[25962](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373334, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:54.198412 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 26582
I20260810 14:48:54.198503 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:54.198680 19575 external_mini_cluster.cc:1428] Setting key 062390dba23be1e2914a358a5c362724
I20260810 14:48:54.199663 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.191768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:42403 (local address 127.19.29.254:45459)
0810 14:48:54.191827 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.191829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.192001 (+ 172us) server_negotiation.cc:407] Connection header received
0810 14:48:54.192530 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.192531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.192545 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.192600 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.193506 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.194067 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.195082 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.195274 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.195331 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.197178 (+ 1847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.197180 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.197180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:54.197188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.198241 (+ 1053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.198668 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.198670 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.198670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.198730 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.199022 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.199024 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.199024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.199156 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.199215 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.199517 (+ 302us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.199600 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:54.199846 26799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.191737 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45459 (local address 127.19.29.195:42403)
0810 14:48:54.191895 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.191928 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.192395 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.192681 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.192685 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.192920 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.193407 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.193412 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.194158 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.194159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.195003 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.195006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.195343 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.195345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.195464 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.195828 (+ 364us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:54.195835 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.197093 (+ 1258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.198349 (+ 1256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:54.198356 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:54.198358 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:54.198599 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:54.198797 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:54.198798 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:54.198798 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:54.198936 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:54.199218 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.199225 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.199376 (+ 151us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.199474 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.199634 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":83,"threads_started":1}
I20260810 14:48:54.200255 26796 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45459
I20260810 14:48:54.200340 26796 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:54.200448 26796 heartbeater.cc:511] Master 127.19.29.254:45459 requested a full tablet report, sending...
I20260810 14:48:54.200789 26031 ts_manager.cc:194] Registered new tserver with Master: 348161808cf54437996911f79a843bf7 (127.19.29.195:43185)
I20260810 14:48:54.201180 26031 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:42403
I20260810 14:48:54.210270 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:48:54.217023 26092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.211527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60624 (local address 127.19.29.254:45459)
0810 14:48:54.211629 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.211631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.211640 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:54.211689 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.211690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.211699 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.211745 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.212277 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.212759 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.213495 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.213696 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.213747 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.214914 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.214916 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.214916 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:54.214922 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.216126 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.216415 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.216416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.216416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.216457 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:54.216607 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:54.216607 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:54.216607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:54.216741 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.216810 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.216905 (+ 95us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.216958 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260810 14:48:54.218513 26031 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:54.220027 26031 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:54.226125 26808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43185 (local address 127.0.0.1:46884)
0810 14:48:54.222640 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.222647 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.222693 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.222953 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.222954 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.222955 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:54.222988 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.222989 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.223842 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.223843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.224978 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.224981 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.225830 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.225831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.225908 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.225921 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.225992 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.226041 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":57,"threads_started":1}
I20260810 14:48:54.226141 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46884 (local address 127.19.29.195:43185)
0810 14:48:54.222509 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.222513 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.222703 (+ 190us) server_negotiation.cc:407] Connection header received
0810 14:48:54.222757 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.222759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.222774 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.222846 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:54.223107 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.223753 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.225069 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.225745 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.225821 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.225876 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.226015 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.226058 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":74,"threads_started":1}
I20260810 14:48:54.226792 26688 tablet_service.cc:1467] Processing CreateTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea (DEFAULT_TABLE table=test-table [id=3e61d09dc62f4cb6947576c4a9abb266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.227141 26688 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d918ad43db5144f1a2cbbfd6ebc45fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.227222 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:42251 (local address 127.0.0.1:45074)
0810 14:48:54.222369 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.222409 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.222486 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.222833 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.222836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.222838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:54.222900 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.222902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.225356 (+ 2454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.225356 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.226111 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.226114 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.227005 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.227006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.227064 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.227067 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.227114 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.227156 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"spinlock_wait_cycles":768,"thread_start_us":69,"threads_started":1}
I20260810 14:48:54.227502 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45074 (local address 127.19.29.194:42251)
0810 14:48:54.222367 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.222372 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.222588 (+ 216us) server_negotiation.cc:407] Connection header received
0810 14:48:54.222639 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.222641 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.222661 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.222729 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:54.223064 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.224222 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.226334 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.226862 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.226907 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.226952 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.227140 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.227184 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":80,"threads_started":1}
I20260810 14:48:54.227578 26811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:46065 (local address 127.0.0.1:55634)
0810 14:48:54.222509 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.222519 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.222572 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.222912 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.222913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.222915 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:54.222961 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.222963 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.224330 (+ 1367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.224331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.225288 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.225290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.227348 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.227349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.227411 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.227415 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.227462 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.227507 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"mutex_wait_us":2,"thread_start_us":67,"threads_started":1}
I20260810 14:48:54.227628 26812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.222252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55634 (local address 127.19.29.193:46065)
0810 14:48:54.222468 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.222473 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.222574 (+ 101us) server_negotiation.cc:407] Connection header received
0810 14:48:54.222640 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.222641 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.222655 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.222810 (+ 155us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:54.223029 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.224221 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.225362 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.226095 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.226160 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.226220 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.227502 (+ 1282us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.227549 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":104,"threads_started":1}
I20260810 14:48:54.228277 26225 tablet_service.cc:1467] Processing CreateTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea (DEFAULT_TABLE table=test-table [id=3e61d09dc62f4cb6947576c4a9abb266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.228340 26440 tablet_service.cc:1467] Processing CreateTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea (DEFAULT_TABLE table=test-table [id=3e61d09dc62f4cb6947576c4a9abb266]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.228648 26440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d918ad43db5144f1a2cbbfd6ebc45fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.228655 26225 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d918ad43db5144f1a2cbbfd6ebc45fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.230542 26815 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Bootstrap starting.
I20260810 14:48:54.231276 26815 tablet_bootstrap.cc:654] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.231529 26818 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Bootstrap starting.
I20260810 14:48:54.231717 26819 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: Bootstrap starting.
I20260810 14:48:54.231992 26815 log.cc:824] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.232242 26818 tablet_bootstrap.cc:654] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.232367 26819 tablet_bootstrap.cc:654] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.232772 26815 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: No bootstrap required, opened a new log
I20260810 14:48:54.232795 26818 log.cc:824] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.232823 26819 log.cc:824] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.232848 26815 ts_tablet_manager.cc:1397] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:48:54.233559 26819 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: No bootstrap required, opened a new log
I20260810 14:48:54.233631 26819 ts_tablet_manager.cc:1397] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:54.234609 26818 tablet_bootstrap.cc:492] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: No bootstrap required, opened a new log
I20260810 14:48:54.234673 26818 ts_tablet_manager.cc:1397] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 14:48:54.234740 26815 raft_consensus.cc:348] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.234913 26815 raft_consensus.cc:374] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.234956 26815 raft_consensus.cc:729] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 348161808cf54437996911f79a843bf7, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.235092 26815 consensus_queue.cc:260] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.235383 26796 heartbeater.cc:503] Master 127.19.29.254:45459 was elected leader, sending a full tablet report...
I20260810 14:48:54.235376 26815 ts_tablet_manager.cc:1428] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:48:54.235591 26819 raft_consensus.cc:348] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.235731 26819 raft_consensus.cc:374] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.235767 26819 raft_consensus.cc:729] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 764d7cd9bfe44805907abc11b3860a3c, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.235868 26819 consensus_queue.cc:260] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.236119 26819 ts_tablet_manager.cc:1428] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:48:54.236125 26328 heartbeater.cc:503] Master 127.19.29.254:45459 was elected leader, sending a full tablet report...
I20260810 14:48:54.236384 26818 raft_consensus.cc:348] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.236536 26818 raft_consensus.cc:374] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.236691 26818 raft_consensus.cc:729] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10c1e29290e84205a51e57b247bb72b1, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.236806 26818 consensus_queue.cc:260] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.237073 26571 heartbeater.cc:503] Master 127.19.29.254:45459 was elected leader, sending a full tablet report...
I20260810 14:48:54.237074 26818 ts_tablet_manager.cc:1428] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:48:54.254081 26829 raft_consensus.cc:482] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:54.254187 26829 raft_consensus.cc:504] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.254541 26829 leader_election.cc:288] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 764d7cd9bfe44805907abc11b3860a3c (127.19.29.193:46065), 348161808cf54437996911f79a843bf7 (127.19.29.195:43185)
I20260810 14:48:54.258122 26814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.254850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:51965 (local address 127.19.29.195:43185)
0810 14:48:54.254912 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.254914 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.255008 (+ 94us) server_negotiation.cc:407] Connection header received
0810 14:48:54.255072 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.255073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.255084 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.255138 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:54.255245 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.255902 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257166 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.257733 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257808 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.257817 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.257998 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.258048 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:54.258127 26812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.254756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:59573 (local address 127.19.29.193:46065)
0810 14:48:54.254818 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.254820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.254828 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:48:54.254854 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.254855 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.254865 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.254915 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:48:54.255060 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.255805 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257159 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.257733 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257808 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.257817 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.257998 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.258072 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:48:54.258123 26574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.254688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:46065 (local address 127.19.29.194:59573)
0810 14:48:54.254738 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.254749 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.254803 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.254942 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.254943 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.254946 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:54.254998 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.254999 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.255878 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.255878 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.257055 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.257058 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.257812 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.257900 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.257902 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.257957 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.258011 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27,"mutex_wait_us":6}
I20260810 14:48:54.258133 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.254787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43185 (local address 127.19.29.194:51965)
0810 14:48:54.254932 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.254941 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.254999 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.255143 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.255144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.255145 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:48:54.255192 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.255193 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.255960 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.255961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.257078 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:54.257079 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.257812 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.257813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:54.257897 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.257901 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.257958 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.258011 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":21,"thread_start_us":99,"threads_started":1}
I20260810 14:48:54.258525 26257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d918ad43db5144f1a2cbbfd6ebc45fea" candidate_uuid: "10c1e29290e84205a51e57b247bb72b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764d7cd9bfe44805907abc11b3860a3c" is_pre_election: true
I20260810 14:48:54.258671 26257 raft_consensus.cc:2454] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c1e29290e84205a51e57b247bb72b1 in term 0.
I20260810 14:48:54.258653 26723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d918ad43db5144f1a2cbbfd6ebc45fea" candidate_uuid: "10c1e29290e84205a51e57b247bb72b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348161808cf54437996911f79a843bf7" is_pre_election: true
I20260810 14:48:54.258796 26723 raft_consensus.cc:2454] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10c1e29290e84205a51e57b247bb72b1 in term 0.
I20260810 14:48:54.258884 26364 leader_election.cc:302] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c1e29290e84205a51e57b247bb72b1, 764d7cd9bfe44805907abc11b3860a3c; no voters:
I20260810 14:48:54.259040 26829 raft_consensus.cc:2781] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:54.259099 26829 raft_consensus.cc:482] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:54.259128 26829 raft_consensus.cc:3037] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.259758 26829 raft_consensus.cc:504] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.259861 26829 leader_election.cc:288] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [CANDIDATE]: Term 1 election: Requested vote from peers 764d7cd9bfe44805907abc11b3860a3c (127.19.29.193:46065), 348161808cf54437996911f79a843bf7 (127.19.29.195:43185)
I20260810 14:48:54.260072 26257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d918ad43db5144f1a2cbbfd6ebc45fea" candidate_uuid: "10c1e29290e84205a51e57b247bb72b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "764d7cd9bfe44805907abc11b3860a3c"
I20260810 14:48:54.260072 26723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d918ad43db5144f1a2cbbfd6ebc45fea" candidate_uuid: "10c1e29290e84205a51e57b247bb72b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "348161808cf54437996911f79a843bf7"
I20260810 14:48:54.260157 26257 raft_consensus.cc:3037] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.260157 26723 raft_consensus.cc:3037] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.261022 26257 raft_consensus.cc:2454] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c1e29290e84205a51e57b247bb72b1 in term 1.
I20260810 14:48:54.261024 26723 raft_consensus.cc:2454] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10c1e29290e84205a51e57b247bb72b1 in term 1.
I20260810 14:48:54.261195 26364 leader_election.cc:302] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10c1e29290e84205a51e57b247bb72b1, 348161808cf54437996911f79a843bf7; no voters:
I20260810 14:48:54.261279 26829 raft_consensus.cc:2781] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:54.261411 26829 raft_consensus.cc:686] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 1 LEADER]: Becoming Leader. State: Replica: 10c1e29290e84205a51e57b247bb72b1, State: Running, Role: LEADER
I20260810 14:48:54.261498 26829 consensus_queue.cc:237] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } }
I20260810 14:48:54.262331 26029 catalog_manager.cc:5495] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 10c1e29290e84205a51e57b247bb72b1 (127.19.29.194). New cstate: current_term: 1 leader_uuid: "10c1e29290e84205a51e57b247bb72b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10c1e29290e84205a51e57b247bb72b1" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 42251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 } health_report { overall_health: UNKNOWN } } }
I20260810 14:48:54.270577 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.268256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45082 (local address 127.19.29.194:42251)
0810 14:48:54.268299 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.268301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.268310 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:54.268370 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.268371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.268388 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.268448 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:48:54.268613 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.269065 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.269820 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:54.270034 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:54.270087 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:54.270235 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:48:54.270374 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:48:54.270445 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.270480 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.270500 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:48:54.272085 26723 raft_consensus.cc:1261] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 1 FOLLOWER]: Refusing update from remote peer 10c1e29290e84205a51e57b247bb72b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:54.272102 26257 raft_consensus.cc:1261] T d918ad43db5144f1a2cbbfd6ebc45fea P 764d7cd9bfe44805907abc11b3860a3c [term 1 FOLLOWER]: Refusing update from remote peer 10c1e29290e84205a51e57b247bb72b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:54.272361 26829 consensus_queue.cc:1035] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "348161808cf54437996911f79a843bf7" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43185 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:54.272481 26833 consensus_queue.cc:1035] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "764d7cd9bfe44805907abc11b3860a3c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 46065 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:54.275168 26839 mvcc.cc:205] Tried to move back new op lower bound from 7316985177176387584 to 7316985177135788032. Current Snapshot: MvccSnapshot[applied={T|T < 7316985177176387584 or (T in {7316985177176387584})}]
I20260810 14:48:54.277098 26029 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:54.277200 26029 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:54.277896 26029 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 752eb296899a4d7b98843768bcc34e71: Sending DeleteTablet for 3 replicas of tablet d918ad43db5144f1a2cbbfd6ebc45fea
I20260810 14:48:54.278199 26440 tablet_service.cc:1514] Processing DeleteTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:45074
I20260810 14:48:54.278270 26225 tablet_service.cc:1514] Processing DeleteTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:55634
I20260810 14:48:54.278250 26688 tablet_service.cc:1514] Processing DeleteTablet for tablet d918ad43db5144f1a2cbbfd6ebc45fea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:46884
I20260810 14:48:54.278456 26855 tablet_replica.cc:330] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: stopping tablet replica
I20260810 14:48:54.278543 26855 raft_consensus.cc:2229] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:54.278633 26855 raft_consensus.cc:2258] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:54.278784 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 26126
I20260810 14:48:54.278707 26858 tablet_replica.cc:330] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: stopping tablet replica
I20260810 14:48:54.288756 26855 ts_tablet_manager.cc:1905] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:54.288908 26858 raft_consensus.cc:2229] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:54.289055 26858 raft_consensus.cc:2258] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:54.289551 26858 ts_tablet_manager.cc:1905] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:54.290477 26855 ts_tablet_manager.cc:1918] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:54.290555 26855 log.cc:1196] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d918ad43db5144f1a2cbbfd6ebc45fea
I20260810 14:48:54.290828 26855 ts_tablet_manager.cc:1939] T d918ad43db5144f1a2cbbfd6ebc45fea P 10c1e29290e84205a51e57b247bb72b1: Deleting consensus metadata
I20260810 14:48:54.291251 26007 catalog_manager.cc:4841] TS 10c1e29290e84205a51e57b247bb72b1 (127.19.29.194:42251): tablet d918ad43db5144f1a2cbbfd6ebc45fea (table test-table [id=3e61d09dc62f4cb6947576c4a9abb266]) successfully deleted
I20260810 14:48:54.291651 26858 ts_tablet_manager.cc:1918] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:54.291744 26858 log.cc:1196] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d918ad43db5144f1a2cbbfd6ebc45fea
I20260810 14:48:54.292053 26858 ts_tablet_manager.cc:1939] T d918ad43db5144f1a2cbbfd6ebc45fea P 348161808cf54437996911f79a843bf7: Deleting consensus metadata
I20260810 14:48:54.292562 26008 catalog_manager.cc:4841] TS 348161808cf54437996911f79a843bf7 (127.19.29.195:43185): tablet d918ad43db5144f1a2cbbfd6ebc45fea (table test-table [id=3e61d09dc62f4cb6947576c4a9abb266]) successfully deleted
W20260810 14:48:54.296509 26008 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:46065 (error 108)
I20260810 14:48:54.296684 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 26333
I20260810 14:48:54.305191 26809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.303553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:46065 (local address 127.0.0.1:55644)
0810 14:48:54.305119 (+ 1566us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.305161 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:46065: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1545}
W20260810 14:48:54.305294 26008 catalog_manager.cc:4584] TS 764d7cd9bfe44805907abc11b3860a3c (127.19.29.193:46065): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d918ad43db5144f1a2cbbfd6ebc45fea: Network error: Client connection negotiation failed: client connection to 127.19.29.193:46065: connect: Connection refused (error 111)
I20260810 14:48:54.319931 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 26582
I20260810 14:48:54.327332 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25979
2026-08-10T14:48:54Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2023 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-10T14:48:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:54Z Disabled control of system clock
I20260810 14:48:54.358312 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37067
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37067
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:48:54.437675 26866 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.437866 26866 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.437886 26866 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.438999 26866 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:54.439051 26866 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.439064 26866 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.439073 26866 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:54.439085 26866 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:54.440353 26866 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37067
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37067
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26866
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.440541 26866 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.440770 26866 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:54.445472 26880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.445616 26866 server_base.cc:1034] running on GCE node
W20260810 14:48:54.445480 26873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.445536 26874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.445960 26866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.446249 26866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.447410 26866 hybrid_clock.cc:648] HybridClock initialized: now 1786373334447398 us; error 28 us; skew 500 ppm
I20260810 14:48:54.448630 26866 webserver.cc:460] Webserver started at http://127.19.29.254:42377/ using document root <none> and password file <none>
I20260810 14:48:54.448854 26866 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.448901 26866 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.449028 26866 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.450019 26866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "66ac2d6b39ba47899510bab64fc61604"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "038bd61de48255673784359054317aaa"
server_key_iv: "92a6a3d59d4aa34ab59996065d63bc5d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.450385 26866 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "66ac2d6b39ba47899510bab64fc61604"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "038bd61de48255673784359054317aaa"
server_key_iv: "92a6a3d59d4aa34ab59996065d63bc5d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.451567 26866 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:54.452270 26890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.452423 26866 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:54.452497 26866 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "66ac2d6b39ba47899510bab64fc61604"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "038bd61de48255673784359054317aaa"
server_key_iv: "92a6a3d59d4aa34ab59996065d63bc5d"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.452584 26866 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.455760 26866 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.455991 26866 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.456110 26866 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.459841 26866 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:37067
I20260810 14:48:54.459873 26981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:37067 every 8 connection(s)
I20260810 14:48:54.460153 26866 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:54.460858 26982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.462178 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 26866
I20260810 14:48:54.462255 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:54.462425 19575 external_mini_cluster.cc:1428] Setting key 29a1fc37cea87f4d1dae1fba7e1b5080
I20260810 14:48:54.464391 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: Bootstrap starting.
I20260810 14:48:54.464773 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.462901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60268 (local address 127.19.29.254:37067)
0810 14:48:54.463091 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.463099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.463131 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:48:54.463579 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.463588 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.463643 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.463787 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.464322 (+ 535us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.464326 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.464326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.464330 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.464372 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.464385 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.464462 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.464542 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.464598 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260810 14:48:54.465082 26982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.465400 26982 log.cc:824] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.465998 26982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: No bootstrap required, opened a new log
I20260810 14:48:54.467470 26982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } }
I20260810 14:48:54.467602 26982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.467633 26982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66ac2d6b39ba47899510bab64fc61604, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.467747 26982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } }
I20260810 14:48:54.467836 26982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:54.467868 26982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:54.467916 26982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.468392 26982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } }
I20260810 14:48:54.468488 26982 leader_election.cc:302] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66ac2d6b39ba47899510bab64fc61604; no voters:
I20260810 14:48:54.468640 26982 leader_election.cc:288] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:54.468885 26990 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:54.468884 26982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:54.469033 26990 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [term 1 LEADER]: Becoming Leader. State: Replica: 66ac2d6b39ba47899510bab64fc61604, State: Running, Role: LEADER
I20260810 14:48:54.469130 26990 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } }
I20260810 14:48:54.469460 26993 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66ac2d6b39ba47899510bab64fc61604. Latest consensus state: current_term: 1 leader_uuid: "66ac2d6b39ba47899510bab64fc61604" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } } }
I20260810 14:48:54.469446 26992 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66ac2d6b39ba47899510bab64fc61604" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66ac2d6b39ba47899510bab64fc61604" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37067 } } }
I20260810 14:48:54.469560 26993 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:54.469568 26992 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604 [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:54.469772 27002 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:54.470590 27002 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:54.471920 27002 catalog_manager.cc:1347] Generated new cluster ID: d9398515638544cd8c73ff27f329948d
I20260810 14:48:54.471976 27002 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:54.494136 27002 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:54.494320 27002 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:54.498971 27002 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: Generated new TSK 0
I20260810 14:48:54.499121 27002 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:48:54.504314 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--builtin_ntp_servers=127.19.29.212:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:48:54.586947 27017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.587157 27017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.587183 27017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.588315 27017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.588353 27017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.588385 27017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:54.589748 27017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27017
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.589972 27017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.590219 27017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:54.594993 27028 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.595017 27023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.595001 27024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.595220 27017 server_base.cc:1034] running on GCE node
I20260810 14:48:54.595490 27017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.595715 27017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.596850 27017 hybrid_clock.cc:648] HybridClock initialized: now 1786373334596835 us; error 30 us; skew 500 ppm
I20260810 14:48:54.598070 27017 webserver.cc:460] Webserver started at http://127.19.29.193:45805/ using document root <none> and password file <none>
I20260810 14:48:54.598276 27017 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.598358 27017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.598491 27017 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.599516 27017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "1911b41502ab47829e92e9d7980be3ce"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "0325f888e06edaadcf11e7d7e1ee773c"
server_key_iv: "04dde0a3c1aeeb92daf8a8fe3b571159"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.599838 27017 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "1911b41502ab47829e92e9d7980be3ce"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "0325f888e06edaadcf11e7d7e1ee773c"
server_key_iv: "04dde0a3c1aeeb92daf8a8fe3b571159"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.601001 27017 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:54.601593 27039 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.601753 27017 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:54.601835 27017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "1911b41502ab47829e92e9d7980be3ce"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "0325f888e06edaadcf11e7d7e1ee773c"
server_key_iv: "04dde0a3c1aeeb92daf8a8fe3b571159"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.601895 27017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.605091 27017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.605330 27017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.605444 27017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.605636 27017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:54.605908 27017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:54.605942 27017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.605966 27017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:54.605995 27017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.611423 27017 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:45719
I20260810 14:48:54.611477 27225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:45719 every 8 connection(s)
I20260810 14:48:54.611733 27017 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:48:54.614245 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.612349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:50899 (local address 127.19.29.254:37067)
0810 14:48:54.612396 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.612399 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.612648 (+ 249us) server_negotiation.cc:407] Connection header received
0810 14:48:54.613051 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.613052 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.613057 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.613104 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.614060 (+ 956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.614061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.614062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.614065 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.614079 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.614083 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.614126 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.614181 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.614192 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:48:54.614413 27229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.612339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37067 (local address 127.19.29.193:50899)
0810 14:48:54.612544 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.612574 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.612975 (+ 401us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.613151 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.613154 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.613162 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.613935 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.613936 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.613961 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.613987 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.614129 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.614132 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.614134 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.614181 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.614224 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
I20260810 14:48:54.614837 27226 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37067
I20260810 14:48:54.614925 27226 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:54.615062 27226 heartbeater.cc:511] Master 127.19.29.254:37067 requested a full tablet report, sending...
I20260810 14:48:54.615494 26921 ts_manager.cc:194] Registered new tserver with Master: 1911b41502ab47829e92e9d7980be3ce (127.19.29.193:45719)
I20260810 14:48:54.619678 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 27017
I20260810 14:48:54.619771 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:54.619925 19575 external_mini_cluster.cc:1428] Setting key 290fd2a2ca44f087e53bcdfdcbc45d16
I20260810 14:48:54.620728 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--builtin_ntp_servers=127.19.29.212:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:48:54.700886 27232 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.701076 27232 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.701107 27232 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.702217 27232 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.702255 27232 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.702286 27232 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:54.703625 27232 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27232
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.703857 27232 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.704133 27232 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:54.708974 27240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.709010 27241 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.709012 27243 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.709080 27232 server_base.cc:1034] running on GCE node
I20260810 14:48:54.709398 27232 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.709610 27232 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.710749 27232 hybrid_clock.cc:648] HybridClock initialized: now 1786373334710738 us; error 25 us; skew 500 ppm
I20260810 14:48:54.711923 27232 webserver.cc:460] Webserver started at http://127.19.29.194:38017/ using document root <none> and password file <none>
I20260810 14:48:54.712136 27232 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.712180 27232 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.712287 27232 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.713287 27232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "3b1807d0ee2d48a9888d030bedd5d6cc"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "92b7bfb1b2301251e9aea5cdd1d4d113"
server_key_iv: "1e60e312079ab0c09c92fb7e8e7d7553"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.713613 27232 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "3b1807d0ee2d48a9888d030bedd5d6cc"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "92b7bfb1b2301251e9aea5cdd1d4d113"
server_key_iv: "1e60e312079ab0c09c92fb7e8e7d7553"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.714849 27232 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:54.715499 27255 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.715657 27232 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:54.715739 27232 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "3b1807d0ee2d48a9888d030bedd5d6cc"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "92b7bfb1b2301251e9aea5cdd1d4d113"
server_key_iv: "1e60e312079ab0c09c92fb7e8e7d7553"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.715801 27232 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.718969 27232 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.719199 27232 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.719309 27232 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.719493 27232 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:54.719770 27232 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:54.719801 27232 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.719828 27232 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:54.719851 27232 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.725236 27232 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38909
I20260810 14:48:54.725272 27434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38909 every 8 connection(s)
I20260810 14:48:54.725581 27232 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:54.728356 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.726258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:54095 (local address 127.19.29.254:37067)
0810 14:48:54.726351 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.726353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.726517 (+ 164us) server_negotiation.cc:407] Connection header received
0810 14:48:54.726985 (+ 468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.726986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.726992 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.727043 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.728123 (+ 1080us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.728125 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.728125 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.728130 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.728146 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.728151 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.728200 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.728272 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.728286 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260810 14:48:54.728519 27437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.726195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37067 (local address 127.19.29.194:54095)
0810 14:48:54.726410 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.726440 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.726887 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.727108 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.727112 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.727120 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.727979 (+ 859us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.727979 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.728006 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.728032 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.728204 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.728209 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.728212 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.728280 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.728338 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":105,"threads_started":1}
I20260810 14:48:54.728933 27435 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37067
I20260810 14:48:54.729013 27435 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:54.729120 27435 heartbeater.cc:511] Master 127.19.29.254:37067 requested a full tablet report, sending...
I20260810 14:48:54.729422 26921 ts_manager.cc:194] Registered new tserver with Master: 3b1807d0ee2d48a9888d030bedd5d6cc (127.19.29.194:38909)
I20260810 14:48:54.735670 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 27232
I20260810 14:48:54.735751 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:54.735895 19575 external_mini_cluster.cc:1428] Setting key b89d959b981a387bc3848fe7fbfefb39
I20260810 14:48:54.736701 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--builtin_ntp_servers=127.19.29.212:45655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260810 14:48:54.816210 27439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:54.816401 27439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:54.816419 27439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:54.817559 27439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:54.817602 27439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:54.817626 27439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:54.819058 27439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37067
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:54.819273 27439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:54.819545 27439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:54.824301 27449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.824342 27439 server_base.cc:1034] running on GCE node
W20260810 14:48:54.824330 27445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:54.824308 27444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:54.824736 27439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:54.824963 27439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:54.826131 27439 hybrid_clock.cc:648] HybridClock initialized: now 1786373334826116 us; error 31 us; skew 500 ppm
I20260810 14:48:54.827423 27439 webserver.cc:460] Webserver started at http://127.19.29.195:33471/ using document root <none> and password file <none>
I20260810 14:48:54.827646 27439 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:54.827689 27439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:54.827817 27439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:54.828840 27439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "ba0cfb01078c41129a3704a68e1fe14e"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "72eb5671e56659d39255080806859d7a"
server_key_iv: "29fa0c7e7b4666485f93c21ce3563e58"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.829172 27439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "ba0cfb01078c41129a3704a68e1fe14e"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "72eb5671e56659d39255080806859d7a"
server_key_iv: "29fa0c7e7b4666485f93c21ce3563e58"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.830497 27439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:54.831290 27458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.831436 27439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:54.831521 27439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "ba0cfb01078c41129a3704a68e1fe14e"
format_stamp: "Formatted at 2026-08-10 14:48:54 on dist-test-slave-4tdj"
server_key: "72eb5671e56659d39255080806859d7a"
server_key_iv: "29fa0c7e7b4666485f93c21ce3563e58"
server_key_version: "encryptionkey@0"
I20260810 14:48:54.831590 27439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:54.834812 27439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:54.835038 27439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:54.835145 27439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:54.835325 27439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:54.835592 27439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:54.835621 27439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.835660 27439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:54.835685 27439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:54.840989 27439 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:38331
I20260810 14:48:54.841032 27641 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:38331 every 8 connection(s)
I20260810 14:48:54.841303 27439 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:48:54.843912 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.841929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:38481 (local address 127.19.29.254:37067)
0810 14:48:54.841987 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.841989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.842225 (+ 236us) server_negotiation.cc:407] Connection header received
0810 14:48:54.842695 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.842696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.842702 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.842756 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.843733 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.843734 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.843735 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.843738 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.843753 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.843757 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.843798 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.843844 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.843855 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:48:54.844063 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.841897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37067 (local address 127.19.29.195:38481)
0810 14:48:54.842086 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.842124 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.842606 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.842805 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.842809 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.842817 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.843603 (+ 786us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.843603 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.843629 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.843657 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.843799 (+ 142us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.843801 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.843803 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.843849 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.843894 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":84,"threads_started":1}
I20260810 14:48:54.844478 27645 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37067
I20260810 14:48:54.844560 27645 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:54.844686 27645 heartbeater.cc:511] Master 127.19.29.254:37067 requested a full tablet report, sending...
I20260810 14:48:54.845012 26921 ts_manager.cc:194] Registered new tserver with Master: ba0cfb01078c41129a3704a68e1fe14e (127.19.29.195:38331)
I20260810 14:48:54.851493 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 27439
I20260810 14:48:54.851588 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:54.851706 19575 external_mini_cluster.cc:1428] Setting key 58c17c5bcf4c73f9b87f22222cafb750
I20260810 14:48:54.852422 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:48:54.854475 26986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.853595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60270 (local address 127.19.29.254:37067)
0810 14:48:54.853659 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.853661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.853724 (+ 63us) server_negotiation.cc:407] Connection header received
0810 14:48:54.853764 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.853764 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.853768 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.853810 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.854246 (+ 436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.854247 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.854248 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.854251 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.854262 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.854266 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.854353 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.854400 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.854409 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:48:54.855780 26921 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60270:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:48:54.857229 26921 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:48:54.860589 27656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45719 (local address 127.0.0.1:45062)
0810 14:48:54.859396 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.859432 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.859484 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.859894 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.859895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.859897 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.860228 (+ 331us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.860229 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.860234 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.860241 (+ 7us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.860435 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.860441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.860444 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.860527 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.860537 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":61,"threads_started":1}
I20260810 14:48:54.860605 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40486 (local address 127.19.29.195:38331)
0810 14:48:54.859525 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.859530 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.859540 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:48:54.859563 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.859565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.859575 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.859651 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.860319 (+ 668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.860323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.860323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.860326 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.860357 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.860370 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.860434 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.860516 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.860532 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":87,"threads_started":1}
I20260810 14:48:54.860843 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45062 (local address 127.19.29.193:45719)
0810 14:48:54.859743 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.859747 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.859756 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:54.859782 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.859784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.859793 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.860049 (+ 256us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.860319 (+ 270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.860323 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.860323 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.860326 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.860357 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.860370 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.860431 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.860636 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.860765 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":461,"thread_start_us":76,"threads_started":1}
I20260810 14:48:54.860584 27653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38331 (local address 127.0.0.1:40486)
0810 14:48:54.859397 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.859433 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.859486 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.859660 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.859664 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.859671 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.860087 (+ 416us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.860088 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.860102 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.860119 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.860435 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.860441 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.860444 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.860500 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.860514 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":101,"threads_started":1}
I20260810 14:48:54.861691 27657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38909 (local address 127.0.0.1:43546)
0810 14:48:54.859562 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.859570 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.859603 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.860685 (+ 1082us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.860686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.860689 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.861257 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.861257 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.861263 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.861276 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.861571 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.861572 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.861572 (+ 0us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.861620 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.861632 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":7,"thread_start_us":75,"threads_started":1}
I20260810 14:48:54.861728 27665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.859567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43546 (local address 127.19.29.194:38909)
0810 14:48:54.860523 (+ 956us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.860527 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.860536 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:54.860559 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.860561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.860570 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.860833 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.861469 (+ 636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.861472 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.861472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.861475 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.861499 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.861508 (+ 9us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.861557 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.861632 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.861652 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":913,"thread_start_us":79,"threads_started":1}
I20260810 14:48:54.861622 27540 tablet_service.cc:1467] Processing CreateTablet for tablet 255f2a8210e84ae3955a8ce135b23732 (DEFAULT_TABLE table=test-table [id=f3fdefe833f8418583ded6ee37822939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.861665 27115 tablet_service.cc:1467] Processing CreateTablet for tablet 255f2a8210e84ae3955a8ce135b23732 (DEFAULT_TABLE table=test-table [id=f3fdefe833f8418583ded6ee37822939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.861982 27540 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 255f2a8210e84ae3955a8ce135b23732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.861999 27115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 255f2a8210e84ae3955a8ce135b23732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.862563 27323 tablet_service.cc:1467] Processing CreateTablet for tablet 255f2a8210e84ae3955a8ce135b23732 (DEFAULT_TABLE table=test-table [id=f3fdefe833f8418583ded6ee37822939]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:48:54.862848 27323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 255f2a8210e84ae3955a8ce135b23732. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:54.865131 27666 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: Bootstrap starting.
I20260810 14:48:54.865366 27667 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Bootstrap starting.
I20260810 14:48:54.865482 27668 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Bootstrap starting.
I20260810 14:48:54.866051 27668 tablet_bootstrap.cc:654] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.866051 27667 tablet_bootstrap.cc:654] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.866410 27667 log.cc:824] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.866410 27668 log.cc:824] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.866938 27666 tablet_bootstrap.cc:654] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:54.867153 27667 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: No bootstrap required, opened a new log
I20260810 14:48:54.867146 27668 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: No bootstrap required, opened a new log
I20260810 14:48:54.867218 27667 ts_tablet_manager.cc:1397] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:54.867225 27668 ts_tablet_manager.cc:1397] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:48:54.867225 27666 log.cc:824] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:54.867878 27666 tablet_bootstrap.cc:492] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: No bootstrap required, opened a new log
I20260810 14:48:54.867938 27666 ts_tablet_manager.cc:1397] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 14:48:54.869669 27668 raft_consensus.cc:348] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.869668 27667 raft_consensus.cc:348] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.869832 27668 raft_consensus.cc:374] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.869832 27667 raft_consensus.cc:374] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.869875 27667 raft_consensus.cc:729] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba0cfb01078c41129a3704a68e1fe14e, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.869875 27668 raft_consensus.cc:729] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b1807d0ee2d48a9888d030bedd5d6cc, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.869846 27666 raft_consensus.cc:348] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.870007 27666 raft_consensus.cc:374] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:54.870008 27667 consensus_queue.cc:260] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.870008 27668 consensus_queue.cc:260] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.870054 27666 raft_consensus.cc:729] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1911b41502ab47829e92e9d7980be3ce, State: Initialized, Role: FOLLOWER
I20260810 14:48:54.870157 27666 consensus_queue.cc:260] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.870273 27667 ts_tablet_manager.cc:1428] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:48:54.870273 27668 ts_tablet_manager.cc:1428] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:48:54.870406 27645 heartbeater.cc:503] Master 127.19.29.254:37067 was elected leader, sending a full tablet report...
I20260810 14:48:54.870406 27435 heartbeater.cc:503] Master 127.19.29.254:37067 was elected leader, sending a full tablet report...
I20260810 14:48:54.870424 27666 ts_tablet_manager.cc:1428] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:48:54.870530 27226 heartbeater.cc:503] Master 127.19.29.254:37067 was elected leader, sending a full tablet report...
I20260810 14:48:54.939455 27676 raft_consensus.cc:482] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:48:54.939606 27676 raft_consensus.cc:504] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.939958 27676 leader_election.cc:288] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1911b41502ab47829e92e9d7980be3ce (127.19.29.193:45719), 3b1807d0ee2d48a9888d030bedd5d6cc (127.19.29.194:38909)
I20260810 14:48:54.941175 27647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.940148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45719 (local address 127.19.29.195:49015)
0810 14:48:54.940200 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.940212 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.940249 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.940405 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.940406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.940408 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.940881 (+ 473us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.940881 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.940888 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.940899 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.941065 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.941066 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.941067 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.941112 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.941124 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 14:48:54.941197 27663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.940228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:49015 (local address 127.19.29.193:45719)
0810 14:48:54.940269 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.940271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.940300 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:48:54.940326 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.940327 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.940333 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.940388 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.940965 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.940967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.940968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.940973 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.940993 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.940997 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.941057 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.941114 (+ 57us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.941127 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:48:54.941342 27680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.940156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38909 (local address 127.19.29.195:45407)
0810 14:48:54.940393 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.940404 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:54.940468 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:54.940588 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:54.940588 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:54.940591 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:54.941027 (+ 436us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:48:54.941027 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:54.941032 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:48:54.941042 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:54.941209 (+ 167us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:54.941209 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:54.941210 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:48:54.941255 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:48:54.941267 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"mutex_wait_us":47,"thread_start_us":120,"threads_started":1}
I20260810 14:48:54.941432 27665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.940211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:45407 (local address 127.19.29.194:38909)
0810 14:48:54.940257 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.940260 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.940474 (+ 214us) server_negotiation.cc:407] Connection header received
0810 14:48:54.940507 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.940508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.940514 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.940576 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.941127 (+ 551us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.941128 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.941128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.941133 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.941150 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.941154 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.941206 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.941346 (+ 140us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.941361 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:48:54.941748 27144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "255f2a8210e84ae3955a8ce135b23732" candidate_uuid: "ba0cfb01078c41129a3704a68e1fe14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1911b41502ab47829e92e9d7980be3ce" is_pre_election: true
I20260810 14:48:54.941797 27356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "255f2a8210e84ae3955a8ce135b23732" candidate_uuid: "ba0cfb01078c41129a3704a68e1fe14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" is_pre_election: true
I20260810 14:48:54.941903 27144 raft_consensus.cc:2454] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba0cfb01078c41129a3704a68e1fe14e in term 0.
I20260810 14:48:54.941947 27356 raft_consensus.cc:2454] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba0cfb01078c41129a3704a68e1fe14e in term 0.
I20260810 14:48:54.942157 27468 leader_election.cc:302] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1911b41502ab47829e92e9d7980be3ce, ba0cfb01078c41129a3704a68e1fe14e; no voters:
I20260810 14:48:54.942308 27676 raft_consensus.cc:2781] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:48:54.942371 27676 raft_consensus.cc:482] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:48:54.942395 27676 raft_consensus.cc:3037] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.943109 27676 raft_consensus.cc:504] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.943291 27676 leader_election.cc:288] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [CANDIDATE]: Term 1 election: Requested vote from peers 1911b41502ab47829e92e9d7980be3ce (127.19.29.193:45719), 3b1807d0ee2d48a9888d030bedd5d6cc (127.19.29.194:38909)
I20260810 14:48:54.943362 27144 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "255f2a8210e84ae3955a8ce135b23732" candidate_uuid: "ba0cfb01078c41129a3704a68e1fe14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1911b41502ab47829e92e9d7980be3ce"
I20260810 14:48:54.943441 27144 raft_consensus.cc:3037] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.943418 27356 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "255f2a8210e84ae3955a8ce135b23732" candidate_uuid: "ba0cfb01078c41129a3704a68e1fe14e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc"
I20260810 14:48:54.943517 27356 raft_consensus.cc:3037] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:54.944188 27144 raft_consensus.cc:2454] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba0cfb01078c41129a3704a68e1fe14e in term 1.
I20260810 14:48:54.944203 27356 raft_consensus.cc:2454] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba0cfb01078c41129a3704a68e1fe14e in term 1.
I20260810 14:48:54.944358 27461 leader_election.cc:302] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b1807d0ee2d48a9888d030bedd5d6cc, ba0cfb01078c41129a3704a68e1fe14e; no voters:
I20260810 14:48:54.944453 27676 raft_consensus.cc:2781] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:54.944614 27676 raft_consensus.cc:686] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 1 LEADER]: Becoming Leader. State: Replica: ba0cfb01078c41129a3704a68e1fe14e, State: Running, Role: LEADER
I20260810 14:48:54.944722 27676 consensus_queue.cc:237] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } }
I20260810 14:48:54.945588 26920 catalog_manager.cc:5495] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e reported cstate change: term changed from 0 to 1, leader changed from <none> to ba0cfb01078c41129a3704a68e1fe14e (127.19.29.195). New cstate: current_term: 1 leader_uuid: "ba0cfb01078c41129a3704a68e1fe14e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba0cfb01078c41129a3704a68e1fe14e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 } health_report { overall_health: UNKNOWN } } }
I20260810 14:48:54.952848 27664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.951955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40490 (local address 127.19.29.195:38331)
0810 14:48:54.952010 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:54.952012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:54.952020 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:48:54.952082 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:54.952083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:54.952097 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:54.952142 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:54.952647 (+ 505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:54.952648 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:54.952648 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:54.952652 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:54.952667 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:54.952671 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:54.952716 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:54.952768 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 14:48:54.952778 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:48:54.954452 27356 raft_consensus.cc:1261] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 1 FOLLOWER]: Refusing update from remote peer ba0cfb01078c41129a3704a68e1fe14e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:54.954491 27144 raft_consensus.cc:1261] T 255f2a8210e84ae3955a8ce135b23732 P 1911b41502ab47829e92e9d7980be3ce [term 1 FOLLOWER]: Refusing update from remote peer ba0cfb01078c41129a3704a68e1fe14e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:48:54.954805 27681 consensus_queue.cc:1035] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "1911b41502ab47829e92e9d7980be3ce" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:54.954922 27676 consensus_queue.cc:1035] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b1807d0ee2d48a9888d030bedd5d6cc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:48:54.957078 27687 mvcc.cc:205] Tried to move back new op lower bound from 7316985179971186688 to 7316985179934257152. Current Snapshot: MvccSnapshot[applied={T|T < 7316985179971186688}]
I20260810 14:48:54.957535 27688 mvcc.cc:205] Tried to move back new op lower bound from 7316985179971186688 to 7316985179934257152. Current Snapshot: MvccSnapshot[applied={T|T < 7316985179971186688 or (T in {7316985179971186688})}]
I20260810 14:48:54.959510 26921 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:54.959605 26921 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60270:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:48:54.960285 26921 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 66ac2d6b39ba47899510bab64fc61604: Sending DeleteTablet for 3 replicas of tablet 255f2a8210e84ae3955a8ce135b23732
I20260810 14:48:54.960585 27323 tablet_service.cc:1514] Processing DeleteTablet for tablet 255f2a8210e84ae3955a8ce135b23732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='slave'} at 127.0.0.1:43546
I20260810 14:48:54.960611 27115 tablet_service.cc:1514] Processing DeleteTablet for tablet 255f2a8210e84ae3955a8ce135b23732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='slave'} at 127.0.0.1:45062
I20260810 14:48:54.960611 27540 tablet_service.cc:1514] Processing DeleteTablet for tablet 255f2a8210e84ae3955a8ce135b23732 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:48:54 UTC) from {username='slave'} at 127.0.0.1:40486
I20260810 14:48:54.960879 27703 tablet_replica.cc:330] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: stopping tablet replica
I20260810 14:48:54.960974 27703 raft_consensus.cc:2229] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:48:54.961057 27703 raft_consensus.cc:2258] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:54.961123 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 27017
I20260810 14:48:54.968712 27701 tablet_replica.cc:330] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: stopping tablet replica
I20260810 14:48:54.968820 27701 raft_consensus.cc:2229] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:48:54.968917 27701 raft_consensus.cc:2258] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:48:54.970528 27701 ts_tablet_manager.cc:1905] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:54.970759 27703 ts_tablet_manager.cc:1905] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:48:54.972146 27701 ts_tablet_manager.cc:1918] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:54.972219 27701 log.cc:1196] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/255f2a8210e84ae3955a8ce135b23732
I20260810 14:48:54.972298 27703 ts_tablet_manager.cc:1918] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:48:54.972371 27703 log.cc:1196] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/255f2a8210e84ae3955a8ce135b23732
I20260810 14:48:54.972469 27701 ts_tablet_manager.cc:1939] T 255f2a8210e84ae3955a8ce135b23732 P 3b1807d0ee2d48a9888d030bedd5d6cc: Deleting consensus metadata
I20260810 14:48:54.972628 27703 ts_tablet_manager.cc:1939] T 255f2a8210e84ae3955a8ce135b23732 P ba0cfb01078c41129a3704a68e1fe14e: Deleting consensus metadata
I20260810 14:48:54.972874 26896 catalog_manager.cc:4841] TS 3b1807d0ee2d48a9888d030bedd5d6cc (127.19.29.194:38909): tablet 255f2a8210e84ae3955a8ce135b23732 (table test-table [id=f3fdefe833f8418583ded6ee37822939]) successfully deleted
I20260810 14:48:54.972977 26893 catalog_manager.cc:4841] TS ba0cfb01078c41129a3704a68e1fe14e (127.19.29.195:38331): tablet 255f2a8210e84ae3955a8ce135b23732 (table test-table [id=f3fdefe833f8418583ded6ee37822939]) successfully deleted
W20260810 14:48:54.977876 26898 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:45719 (error 108)
I20260810 14:48:54.978087 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 27232
I20260810 14:48:54.978286 27657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:54.978182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45719 (local address 127.0.0.1:45072)
0810 14:48:54.978225 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:54.978256 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45719: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:48:54.979908 26898 catalog_manager.cc:4584] TS 1911b41502ab47829e92e9d7980be3ce (127.19.29.193:45719): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 255f2a8210e84ae3955a8ce135b23732: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45719: connect: Connection refused (error 111)
I20260810 14:48:54.984432 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 27439
I20260810 14:48:54.995635 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 26866
2026-08-10T14:48:55Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (676 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260810 14:48:55.027340 19575 mini_oidc.cc:152] Starting JWKS server
I20260810 14:48:55.028518 19575 webserver.cc:460] Webserver started at https://127.0.0.1:40269/ using document root <none> and password file <none>
I20260810 14:48:55.028605 19575 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:48:55.028738 19575 webserver.cc:460] Webserver started at http://127.0.0.1:37355/ using document root <none> and password file <none>
2026-08-10T14:48:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:55Z Disabled control of system clock
I20260810 14:48:55.036482 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46681
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:33203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:46681
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40269/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/testchainca.cert with env {}
W20260810 14:48:55.115782 27716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:55.115984 27716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:55.116015 27716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:55.117177 27716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:55.117218 27716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:55.117233 27716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:55.117249 27716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:55.117264 27716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:48:55.117280 27716 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:48:55.117298 27716 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:40269/jwks.json
I20260810 14:48:55.118920 27716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:46681
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:40269/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:55.119174 27716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:55.119360 27716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:55.124011 27723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.123987 27727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.123991 27722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:55.124020 27716 server_base.cc:1034] running on GCE node
I20260810 14:48:55.124429 27716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:55.124703 27716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:55.125837 27716 hybrid_clock.cc:648] HybridClock initialized: now 1786373335125821 us; error 36 us; skew 500 ppm
I20260810 14:48:55.126995 27716 webserver.cc:460] Webserver started at http://127.19.29.254:40993/ using document root <none> and password file <none>
I20260810 14:48:55.127213 27716 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:55.127260 27716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:55.127380 27716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:55.128368 27716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "c6ff3fe597ba497d919e65b5c080aa9c"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "45c285038a00dda656cfc7499e59eecb"
server_key_iv: "cd0fa38a56ec31201ae016b6e3c0056d"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.128706 27716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "c6ff3fe597ba497d919e65b5c080aa9c"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "45c285038a00dda656cfc7499e59eecb"
server_key_iv: "cd0fa38a56ec31201ae016b6e3c0056d"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.129858 27716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:55.130535 27737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:55.130689 27716 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:55.130775 27716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "c6ff3fe597ba497d919e65b5c080aa9c"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "45c285038a00dda656cfc7499e59eecb"
server_key_iv: "cd0fa38a56ec31201ae016b6e3c0056d"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.130831 27716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:55.165508 27716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:55.165843 27716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:55.165982 27716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:55.169914 27716 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:46681
I20260810 14:48:55.169972 27826 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:46681 every 8 connection(s)
I20260810 14:48:55.170276 27716 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:55.170624 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 27716
I20260810 14:48:55.170739 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:55.170972 19575 external_mini_cluster.cc:1428] Setting key 6fe8af29a02af78c7ce5ed63b473c4e1
I20260810 14:48:55.171546 27827 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:55.174695 27827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c: Bootstrap starting.
I20260810 14:48:55.175359 27827 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:55.175722 27827 log.cc:824] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:55.176433 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.171537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42798 (local address 127.19.29.254:46681)
0810 14:48:55.171754 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.171762 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.171787 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:48:55.172248 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.172254 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.172313 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.172424 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:55.172672 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.173510 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.174629 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.175061 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.175154 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.175816 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:55.175820 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:55.175821 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:55.175989 (+ 168us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:55.176030 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:55.176042 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:55.176097 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:55.176187 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 14:48:55.176267 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
I20260810 14:48:55.176487 27827 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c: No bootstrap required, opened a new log
I20260810 14:48:55.177400 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:48:55.178619 27827 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } }
I20260810 14:48:55.178759 27827 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:55.178785 27827 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ff3fe597ba497d919e65b5c080aa9c, State: Initialized, Role: FOLLOWER
I20260810 14:48:55.178907 27827 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } }
I20260810 14:48:55.178985 27827 raft_consensus.cc:388] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:55.179010 27827 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:55.179057 27827 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:55.179606 27827 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } }
I20260810 14:48:55.179714 27827 leader_election.cc:302] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c6ff3fe597ba497d919e65b5c080aa9c; no voters:
I20260810 14:48:55.179875 27827 leader_election.cc:288] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:55.179929 27835 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:55.180079 27835 raft_consensus.cc:686] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [term 1 LEADER]: Becoming Leader. State: Replica: c6ff3fe597ba497d919e65b5c080aa9c, State: Running, Role: LEADER
I20260810 14:48:55.180138 27827 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:55.180172 27835 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } }
I20260810 14:48:55.180557 27839 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } } }
I20260810 14:48:55.180583 27841 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6ff3fe597ba497d919e65b5c080aa9c. Latest consensus state: current_term: 1 leader_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c6ff3fe597ba497d919e65b5c080aa9c" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46681 } } }
I20260810 14:48:55.180670 27839 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.180678 27841 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.180896 27849 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:55.181391 27849 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:55.182996 27849 catalog_manager.cc:1347] Generated new cluster ID: 7532e4a63ba4437a9940a7293c4ed6fb
I20260810 14:48:55.183048 27849 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:55.192203 27849 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:55.192682 27849 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:55.197877 27849 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c6ff3fe597ba497d919e65b5c080aa9c: Generated new TSK 0
I20260810 14:48:55.198040 27849 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 14:48:55.221406 27883 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260810 14:48:55.221580 27883 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260810 14:48:55.222114 27878 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:55.206789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46681 (local address 127.0.0.1:42814)
0810 14:48:55.206982 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:55.206993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:55.207062 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:55.207248 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:55.207250 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:55.207251 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:48:55.207336 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.207338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.207984 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.207985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.208583 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.208586 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.208949 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.208950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.209022 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.209043 (+ 21us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:48:55.221673 (+ 12630us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 14:48:55.221771 (+ 98us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.29.254:46681: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":74,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.19.29.254:46681: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260810 14:48:55.222570 27833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.206849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42814 (local address 127.19.29.254:46681)
0810 14:48:55.206903 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.206906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.207048 (+ 142us) server_negotiation.cc:407] Connection header received
0810 14:48:55.207158 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.207159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.207174 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.207241 (+ 67us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:48:55.207406 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.207903 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.208665 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.208869 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.208930 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.209140 (+ 210us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:48:55.221500 (+ 12360us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0810 14:48:55.222488 (+ 988us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42814: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:48:55.222609 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 27716
W20260810 14:48:55.222646 27833 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42814: Failed to load JWKS: Error downloading JWKS from 'https://localhost:40269/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
2026-08-10T14:48:55Z chronyd exiting
I20260810 14:48:55.281723 19575 test_util.cc:175] -----------------------------------------------
I20260810 14:48:55.281807 19575 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786373310130398-19575-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (255 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260810 14:48:55.282626 19575 mini_oidc.cc:152] Starting JWKS server
I20260810 14:48:55.283290 19575 webserver.cc:460] Webserver started at https://127.0.0.1:44237/ using document root <none> and password file <none>
I20260810 14:48:55.283332 19575 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:48:55.283463 19575 webserver.cc:460] Webserver started at http://127.0.0.1:46877/ using document root <none> and password file <none>
2026-08-10T14:48:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:55Z Disabled control of system clock
I20260810 14:48:55.291692 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39689
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:42061
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:39689
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44237/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/testchainca.cert with env {}
W20260810 14:48:55.370191 27890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:55.370394 27890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:55.370415 27890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:55.371531 27890 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:55.371568 27890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:55.371587 27890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:55.371603 27890 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:55.371618 27890 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:48:55.371632 27890 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:48:55.371644 27890 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44237/jwks.json
I20260810 14:48:55.373096 27890 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42061
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:39689
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44237/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:55.373276 27890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:55.373431 27890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:55.378108 27903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.378134 27902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.378108 27910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:55.378137 27890 server_base.cc:1034] running on GCE node
I20260810 14:48:55.378610 27890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:55.378870 27890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:55.380023 27890 hybrid_clock.cc:648] HybridClock initialized: now 1786373335380006 us; error 25 us; skew 500 ppm
I20260810 14:48:55.381218 27890 webserver.cc:460] Webserver started at http://127.19.29.254:32947/ using document root <none> and password file <none>
I20260810 14:48:55.381417 27890 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:55.381462 27890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:55.381583 27890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:55.382587 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "577b2abbd509490ea6cd9e05630cb9de"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "59b0e1af505c3c6fd096f8139d225ff0"
server_key_iv: "2a5aeed6b517b58bac1688d343107c75"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.382902 27890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "577b2abbd509490ea6cd9e05630cb9de"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "59b0e1af505c3c6fd096f8139d225ff0"
server_key_iv: "2a5aeed6b517b58bac1688d343107c75"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.384060 27890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:55.384768 27925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:55.384925 27890 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:55.385018 27890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "577b2abbd509490ea6cd9e05630cb9de"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "59b0e1af505c3c6fd096f8139d225ff0"
server_key_iv: "2a5aeed6b517b58bac1688d343107c75"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.385074 27890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:55.410491 27890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:55.410820 27890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:55.410952 27890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:55.414698 27890 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:39689
I20260810 14:48:55.414732 28007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:39689 every 8 connection(s)
I20260810 14:48:55.415053 27890 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:55.415746 28009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:55.415782 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 27890
I20260810 14:48:55.415874 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:55.416038 19575 external_mini_cluster.cc:1428] Setting key 739acb857a761645fabcd239b70875da
I20260810 14:48:55.419787 28009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de: Bootstrap starting.
I20260810 14:48:55.420368 28009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:55.420675 28009 log.cc:824] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:55.421468 28009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de: No bootstrap required, opened a new log
I20260810 14:48:55.421825 28017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.416549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60676 (local address 127.19.29.254:39689)
0810 14:48:55.416776 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.416787 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.416823 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:48:55.417435 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.417445 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.417538 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.417692 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:55.417895 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.419205 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.419970 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.420383 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.420507 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.421128 (+ 621us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:55.421133 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:55.421134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:55.421328 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:55.421368 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:55.421384 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:55.421450 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:55.421548 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 14:48:55.421632 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":84,"threads_started":1}
I20260810 14:48:55.423694 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:48:55.423619 28009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } }
I20260810 14:48:55.423760 28009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:55.423801 28009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 577b2abbd509490ea6cd9e05630cb9de, State: Initialized, Role: FOLLOWER
I20260810 14:48:55.423915 28009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } }
I20260810 14:48:55.423975 28009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:55.424014 28009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:55.424059 28009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:55.424610 28009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } }
I20260810 14:48:55.424718 28009 leader_election.cc:302] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 577b2abbd509490ea6cd9e05630cb9de; no voters:
I20260810 14:48:55.424871 28009 leader_election.cc:288] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:55.424919 28019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:55.425064 28019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [term 1 LEADER]: Becoming Leader. State: Replica: 577b2abbd509490ea6cd9e05630cb9de, State: Running, Role: LEADER
I20260810 14:48:55.425096 28009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:55.425151 28019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } }
I20260810 14:48:55.425554 28021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [sys.catalog]: SysCatalogTable state changed. Reason: New leader 577b2abbd509490ea6cd9e05630cb9de. Latest consensus state: current_term: 1 leader_uuid: "577b2abbd509490ea6cd9e05630cb9de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } } }
I20260810 14:48:55.425637 28021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.425784 28020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "577b2abbd509490ea6cd9e05630cb9de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "577b2abbd509490ea6cd9e05630cb9de" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39689 } } }
I20260810 14:48:55.425840 28020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.425923 28031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:55.426409 28031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:55.431180 28031 catalog_manager.cc:1347] Generated new cluster ID: 7c70265d3f114e0681b17564ac1b5da6
I20260810 14:48:55.431229 28031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:55.466511 28031 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:55.467279 28031 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:55.471962 28031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 577b2abbd509490ea6cd9e05630cb9de: Generated new TSK 0
I20260810 14:48:55.472155 28031 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260810 14:48:55.494886 28054 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260810 14:48:55.494967 28054 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260810 14:48:55.495296 28017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.481515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60686 (local address 127.19.29.254:39689)
0810 14:48:55.481573 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.481575 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.481701 (+ 126us) server_negotiation.cc:407] Connection header received
0810 14:48:55.481763 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.481764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.481778 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.481839 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:48:55.481959 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.482468 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.483250 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.483456 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.483535 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.483685 (+ 150us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:48:55.495065 (+ 11380us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44237/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 14:48:55.495208 (+ 143us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60686: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44237/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 14:48:55.495338 28053 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:55.481456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:39689 (local address 127.0.0.1:60686)
0810 14:48:55.481636 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:55.481645 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:55.481702 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:55.481845 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:55.481846 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:55.481848 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:48:55.481905 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.481907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.482573 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.482574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.483175 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.483177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.483518 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.483519 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.483584 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.483590 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:48:55.495161 (+ 11571us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44237/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0810 14:48:55.495257 (+ 96us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.29.254:39689: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44237/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":90,"threads_started":1}
W20260810 14:48:55.495352 28017 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60686: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44237/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260810 14:48:55.495759 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 27890
2026-08-10T14:48:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (258 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260810 14:48:55.541055 19575 mini_oidc.cc:152] Starting JWKS server
I20260810 14:48:55.541682 19575 webserver.cc:460] Webserver started at https://127.0.0.1:39433/ using document root <none> and password file <none>
I20260810 14:48:55.541723 19575 mini_oidc.cc:189] Starting OIDC Discovery server
I20260810 14:48:55.541829 19575 webserver.cc:460] Webserver started at http://127.0.0.1:39509/ using document root <none> and password file <none>
2026-08-10T14:48:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:55Z Disabled control of system clock
I20260810 14:48:55.549831 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39021
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:40177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:39021
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39433/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 14:48:55.628548 28062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:55.628733 28062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:55.628753 28062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:55.629843 28062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:55.629876 28062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:55.629887 28062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:55.629899 28062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:55.629908 28062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:48:55.629920 28062 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:48:55.629928 28062 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39433/jwks.json
I20260810 14:48:55.631289 28062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:39021
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39433/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:55.631484 28062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:55.631700 28062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:55.636300 28070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:55.636392 28062 server_base.cc:1034] running on GCE node
W20260810 14:48:55.636288 28073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.636525 28075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:55.636773 28062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:55.637064 28062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:55.638206 28062 hybrid_clock.cc:648] HybridClock initialized: now 1786373335638195 us; error 31 us; skew 500 ppm
I20260810 14:48:55.639397 28062 webserver.cc:460] Webserver started at http://127.19.29.254:38219/ using document root <none> and password file <none>
I20260810 14:48:55.639627 28062 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:55.639676 28062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:55.639801 28062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:55.640772 28062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "e2185210004c45b3bcc2a1ee91f7798d"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "7aea18d35a860e3abea9335f4b2b6326"
server_key_iv: "a472c2562e51336fd24c0cef418169ac"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.641103 28062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "e2185210004c45b3bcc2a1ee91f7798d"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "7aea18d35a860e3abea9335f4b2b6326"
server_key_iv: "a472c2562e51336fd24c0cef418169ac"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.642267 28062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:48:55.642978 28086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:55.643136 28062 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:55.643216 28062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "e2185210004c45b3bcc2a1ee91f7798d"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "7aea18d35a860e3abea9335f4b2b6326"
server_key_iv: "a472c2562e51336fd24c0cef418169ac"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.643280 28062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:55.652974 28062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:55.653232 28062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:55.653357 28062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:55.657083 28062 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:39021
I20260810 14:48:55.657114 28172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:39021 every 8 connection(s)
I20260810 14:48:55.657404 28062 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:55.658041 28173 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:55.660672 28173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: Bootstrap starting.
I20260810 14:48:55.661211 28173 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:55.661439 28173 log.cc:824] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:55.662055 28173 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: No bootstrap required, opened a new log
I20260810 14:48:55.663771 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28062
I20260810 14:48:55.663703 28173 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } }
I20260810 14:48:55.663861 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:55.663859 28173 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:55.663892 28173 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2185210004c45b3bcc2a1ee91f7798d, State: Initialized, Role: FOLLOWER
I20260810 14:48:55.664037 19575 external_mini_cluster.cc:1428] Setting key 50c032f970ac2410948319756101490c
I20260810 14:48:55.664047 28173 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } }
I20260810 14:48:55.664129 28173 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:55.664166 28173 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:55.664213 28173 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:55.664824 28173 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } }
I20260810 14:48:55.664915 28173 leader_election.cc:302] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2185210004c45b3bcc2a1ee91f7798d; no voters:
I20260810 14:48:55.665076 28173 leader_election.cc:288] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:55.665164 28181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:55.665344 28173 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:55.665344 28181 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [term 1 LEADER]: Becoming Leader. State: Replica: e2185210004c45b3bcc2a1ee91f7798d, State: Running, Role: LEADER
I20260810 14:48:55.665469 28181 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } }
I20260810 14:48:55.666059 28182 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2185210004c45b3bcc2a1ee91f7798d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } } }
I20260810 14:48:55.666064 28183 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2185210004c45b3bcc2a1ee91f7798d. Latest consensus state: current_term: 1 leader_uuid: "e2185210004c45b3bcc2a1ee91f7798d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2185210004c45b3bcc2a1ee91f7798d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39021 } } }
I20260810 14:48:55.666167 28182 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.666172 28183 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d [sys.catalog]: This master's current role is: LEADER
W20260810 14:48:55.667513 28202 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:48:55.667569 28202 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:48:55.667620 28188 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:55.667755 28188 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:55.669106 28188 catalog_manager.cc:1347] Generated new cluster ID: 03b3652a73084935ae92f96b5414e20c
I20260810 14:48:55.669160 28188 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:55.670459 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.664505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40828 (local address 127.19.29.254:39021)
0810 14:48:55.664731 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.664738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.664763 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:48:55.664852 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.664858 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.664930 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.665083 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:55.665376 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.666987 (+ 1611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.667920 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.668516 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.668632 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.669540 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:55.669544 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:55.669545 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:55.669737 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:55.669778 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:55.669792 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:55.669932 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:55.670117 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 14:48:55.670203 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":75,"threads_started":1}
I20260810 14:48:55.674638 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:48:55.684085 28188 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:55.684574 28188 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:55.691919 28188 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2185210004c45b3bcc2a1ee91f7798d: Generated new TSK 0
I20260810 14:48:55.692097 28188 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:48:55.701947 28180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.698605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40830 (local address 127.19.29.254:39021)
0810 14:48:55.698660 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.698666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.698814 (+ 148us) server_negotiation.cc:407] Connection header received
0810 14:48:55.698894 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.698895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.698906 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.698962 (+ 56us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:48:55.699093 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.699612 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.700697 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.700888 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.700932 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.701104 (+ 172us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:48:55.701764 (+ 660us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39433/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 14:48:55.701889 (+ 125us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40830: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39433/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 14:48:55.701997 28180 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40830: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39433/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260810 14:48:55.702070 28211 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:55.698540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:39021 (local address 127.0.0.1:40830)
0810 14:48:55.698745 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:55.698755 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:55.698829 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:55.698973 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:55.698974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:55.698976 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:48:55.699036 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.699039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.699674 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.699675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.700626 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.700629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.700953 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.700953 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.701022 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.701028 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:48:55.701869 (+ 841us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39433/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0810 14:48:55.701961 (+ 92us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.29.254:39021: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39433/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":77,"threads_started":1}
I20260810 14:48:55.702473 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28062
E20260810 14:48:55.721041 28213 webserver.cc:533] Webserver: sslize failed:
E20260810 14:48:55.721113 28213 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-10T14:48:55Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (207 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-10T14:48:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:55Z Disabled control of system clock
I20260810 14:48:55.756402 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34471
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:33843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:34471
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/testchainca.cert with env {}
W20260810 14:48:55.836283 28227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:55.836488 28227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:55.836520 28227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:55.837675 28227 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:55.837718 28227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:55.837733 28227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:55.837749 28227 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:55.837764 28227 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260810 14:48:55.837779 28227 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260810 14:48:55.837797 28227 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260810 14:48:55.839323 28227 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:34471
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:55.839568 28227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:55.839754 28227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:55.844455 28235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.844442 28239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:55.844442 28237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:55.844786 28227 server_base.cc:1034] running on GCE node
I20260810 14:48:55.845053 28227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:55.845355 28227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:55.846515 28227 hybrid_clock.cc:648] HybridClock initialized: now 1786373335846494 us; error 33 us; skew 500 ppm
I20260810 14:48:55.847667 28227 webserver.cc:460] Webserver started at http://127.19.29.254:35141/ using document root <none> and password file <none>
I20260810 14:48:55.847922 28227 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:55.847971 28227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:55.848098 28227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:55.849149 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "294ab112b5044487a76ac8359db2136f"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "dcf83335170c17c2dde1f2b50f0e466e"
server_key_iv: "be8fcbc66ce5a6247cb99072069e38ba"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.849478 28227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "294ab112b5044487a76ac8359db2136f"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "dcf83335170c17c2dde1f2b50f0e466e"
server_key_iv: "be8fcbc66ce5a6247cb99072069e38ba"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.850684 28227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:48:55.851366 28245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:55.851511 28227 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:55.851593 28227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "294ab112b5044487a76ac8359db2136f"
format_stamp: "Formatted at 2026-08-10 14:48:55 on dist-test-slave-4tdj"
server_key: "dcf83335170c17c2dde1f2b50f0e466e"
server_key_iv: "be8fcbc66ce5a6247cb99072069e38ba"
server_key_version: "encryptionkey@0"
I20260810 14:48:55.851651 28227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:55.886475 28227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:55.886775 28227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:55.886906 28227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:55.890628 28227 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:34471
I20260810 14:48:55.890681 28330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:34471 every 8 connection(s)
I20260810 14:48:55.890980 28227 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:55.891932 28331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:55.894171 28331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f: Bootstrap starting.
I20260810 14:48:55.894784 28331 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:55.895056 28331 log.cc:824] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:55.895714 28331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f: No bootstrap required, opened a new log
I20260810 14:48:55.897280 28331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } }
I20260810 14:48:55.897414 28331 raft_consensus.cc:374] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:55.897449 28331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 294ab112b5044487a76ac8359db2136f, State: Initialized, Role: FOLLOWER
I20260810 14:48:55.897583 28331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } }
I20260810 14:48:55.897645 28331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:55.897675 28331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:48:55.897717 28331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:55.898205 28331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } }
I20260810 14:48:55.898324 28331 leader_election.cc:302] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 294ab112b5044487a76ac8359db2136f; no voters:
I20260810 14:48:55.898471 28331 leader_election.cc:288] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:55.898519 28337 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:55.898670 28337 raft_consensus.cc:686] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [term 1 LEADER]: Becoming Leader. State: Replica: 294ab112b5044487a76ac8359db2136f, State: Running, Role: LEADER
I20260810 14:48:55.898722 28331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:55.898769 28337 consensus_queue.cc:237] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } }
I20260810 14:48:55.899142 28342 sys_catalog.cc:455] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 294ab112b5044487a76ac8359db2136f. Latest consensus state: current_term: 1 leader_uuid: "294ab112b5044487a76ac8359db2136f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } } }
I20260810 14:48:55.899219 28342 sys_catalog.cc:458] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.899216 28339 sys_catalog.cc:455] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "294ab112b5044487a76ac8359db2136f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "294ab112b5044487a76ac8359db2136f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34471 } } }
I20260810 14:48:55.899345 28339 sys_catalog.cc:458] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:55.899847 28353 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:55.900321 28353 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:55.900874 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28227
I20260810 14:48:55.900964 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:55.901132 19575 external_mini_cluster.cc:1428] Setting key f6d2191f3d263de8f7cbd89f25246c44
I20260810 14:48:55.902217 28353 catalog_manager.cc:1347] Generated new cluster ID: 922fd4db44ac4f3cb0af81908bc9281e
I20260810 14:48:55.902276 28353 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:55.907791 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.901506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50260 (local address 127.19.29.254:34471)
0810 14:48:55.901873 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.901880 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.901913 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:48:55.902008 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.902013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.902062 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.902213 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:55.902594 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.903964 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.905008 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.905642 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.905742 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.906982 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:55.906986 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:55.906986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:48:55.907173 (+ 187us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:55.907216 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:48:55.907229 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:55.907276 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:55.907518 (+ 242us) server_negotiation.cc:299] Negotiation successful
0810 14:48:55.907594 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":73,"threads_started":1}
I20260810 14:48:55.908521 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:48:55.924362 28353 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:55.924845 28353 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:55.930454 28353 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 294ab112b5044487a76ac8359db2136f: Generated new TSK 0
I20260810 14:48:55.930644 28353 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:48:56.820519 28367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:55.943837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50270 (local address 127.19.29.254:34471)
0810 14:48:55.943890 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:55.943892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:55.943975 (+ 83us) server_negotiation.cc:407] Connection header received
0810 14:48:55.944031 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:55.944032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:55.944044 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:55.944131 (+ 87us) server_negotiation.cc:226] Negotiated authn=JWT
0810 14:48:55.944290 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.945040 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.945860 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.946170 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.946235 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.946447 (+ 212us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0810 14:48:56.820295 (+873848us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 14:48:56.820460 (+ 165us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50270: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 14:48:56.820587 28367 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50270: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260810 14:48:56.820686 28379 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:55.943759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34471 (local address 127.0.0.1:50270)
0810 14:48:55.943915 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:55.943925 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:55.943978 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:55.944156 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:55.944158 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:55.944160 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0810 14:48:55.944223 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.944225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.945152 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.945153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.945786 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:55.945789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:55.946255 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:55.946256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:55.946344 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:55.946350 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0810 14:48:56.820439 (+874089us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0810 14:48:56.820592 (+ 153us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.19.29.254:34471: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":88,"threads_started":1}
I20260810 14:48:56.821049 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28227
2026-08-10T14:48:56Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1100 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (90 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (91 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:57 dist-test-slave-4tdj krb5kdc[28395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:57 dist-test-slave-4tdj krb5kdc[28395](info): set up 2 sockets
Aug 10 14:48:57 dist-test-slave-4tdj krb5kdc[28395](info): commencing operation
krb5kdc: starting...
W20260810 14:48:58.169657 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.138s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:48:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:48:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:48:58.288916 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:40183
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:40183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:58.369148 28418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:58.369347 28418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:58.369377 28418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:58.370522 28418 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:48:58.370561 28418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:58.370579 28418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:58.370595 28418 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:48:58.370609 28418 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:48:58.372035 28418 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:40183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:40183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:58.372270 28418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:58.372473 28418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:58.376991 28427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:58.377014 28429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:58.377054 28425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.377170 28418 server_base.cc:1034] running on GCE node
I20260810 14:48:58.377516 28418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:58.377797 28418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:58.378957 28418 hybrid_clock.cc:648] HybridClock initialized: now 1786373338378932 us; error 38 us; skew 500 ppm
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.381438 28418 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:48:58.381891 28418 webserver.cc:460] Webserver started at http://127.19.29.254:46649/ using document root <none> and password file <none>
I20260810 14:48:58.382081 28418 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:58.382128 28418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:58.382253 28418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:58.383276 28418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "48e8ccdc99e94d7bbed88b218e93cabf"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "18e9012af91c59973e6ebe29660bc2a9"
server_key_iv: "7bfd6d1c92dca4b65c0db6435cb48a19"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.383613 28418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "48e8ccdc99e94d7bbed88b218e93cabf"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "18e9012af91c59973e6ebe29660bc2a9"
server_key_iv: "7bfd6d1c92dca4b65c0db6435cb48a19"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.384832 28418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:48:58.385502 28442 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.385638 28418 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:48:58.385723 28418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "48e8ccdc99e94d7bbed88b218e93cabf"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "18e9012af91c59973e6ebe29660bc2a9"
server_key_iv: "7bfd6d1c92dca4b65c0db6435cb48a19"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.385782 28418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:58.405951 28418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:58.407851 28418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:58.407989 28418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:58.411979 28418 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:40183
I20260810 14:48:58.412017 28530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:40183 every 8 connection(s)
I20260810 14:48:58.412338 28418 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:48:58.413275 28531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:48:58.413928 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28418
I20260810 14:48:58.414011 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:48:58.414171 19575 external_mini_cluster.cc:1428] Setting key 32c32b00d33673bd144494034c21e883
I20260810 14:48:58.416343 28531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf: Bootstrap starting.
I20260810 14:48:58.417083 28531 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf: Neither blocks nor log segments found. Creating new log.
I20260810 14:48:58.417398 28531 log.cc:824] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf: Log is configured to *not* fsync() on all Append() calls
I20260810 14:48:58.418182 28531 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf: No bootstrap required, opened a new log
I20260810 14:48:58.420200 28531 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } }
I20260810 14:48:58.420343 28531 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:48:58.420382 28531 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48e8ccdc99e94d7bbed88b218e93cabf, State: Initialized, Role: FOLLOWER
I20260810 14:48:58.420511 28531 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } }
I20260810 14:48:58.420580 28531 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:48:58.420614 28531 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:58.420665 28531 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:48:58.421368 28531 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } }
I20260810 14:48:58.421480 28531 leader_election.cc:302] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48e8ccdc99e94d7bbed88b218e93cabf; no voters:
I20260810 14:48:58.421692 28531 leader_election.cc:288] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:48:58.421736 28542 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:48:58.421905 28542 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [term 1 LEADER]: Becoming Leader. State: Replica: 48e8ccdc99e94d7bbed88b218e93cabf, State: Running, Role: LEADER
I20260810 14:48:58.421976 28531 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:48:58.422010 28542 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } }
I20260810 14:48:58.422431 28545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48e8ccdc99e94d7bbed88b218e93cabf. Latest consensus state: current_term: 1 leader_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } } }
I20260810 14:48:58.422538 28545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:58.422713 28544 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48e8ccdc99e94d7bbed88b218e93cabf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 40183 } } }
I20260810 14:48:58.422797 28544 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf [sys.catalog]: This master's current role is: LEADER
I20260810 14:48:58.422943 28549 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:48:58.423511 28549 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:48:58.424894 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.414676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46294 (local address 127.19.29.254:40183)
0810 14:48:58.414868 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.414879 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.414915 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:48:58.415441 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.415451 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.415529 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.415689 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.416223 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.417512 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.418376 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.418810 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.418911 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.421210 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.421214 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.421214 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.421225 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.423263 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.423679 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.423682 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.423682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.423781 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.423984 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.423985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.423985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.424285 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.424425 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.424553 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.424693 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260810 14:48:58.425525 28549 catalog_manager.cc:1347] Generated new cluster ID: be0807913a3c42c9a70cc2c5563d841b
I20260810 14:48:58.425582 28549 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:48:58.447235 28549 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:48:58.447816 28549 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:48:58.451918 28549 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48e8ccdc99e94d7bbed88b218e93cabf: Generated new TSK 0
I20260810 14:48:58.452098 28549 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:48:58.486609 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:58.574653 28577 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:58.574843 28577 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:58.574867 28577 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:58.575976 28577 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:58.576020 28577 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:58.576047 28577 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:48:58.577507 28577 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28577
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:58.577728 28577 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:58.577934 28577 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:58.582720 28591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:58.582763 28583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.582762 28577 server_base.cc:1034] running on GCE node
W20260810 14:48:58.582731 28584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.583055 28577 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:58.583289 28577 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:58.584426 28577 hybrid_clock.cc:648] HybridClock initialized: now 1786373338584414 us; error 27 us; skew 500 ppm
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.586784 28577 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:48:58.587177 28577 webserver.cc:460] Webserver started at http://127.19.29.193:38985/ using document root <none> and password file <none>
I20260810 14:48:58.587381 28577 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:58.587430 28577 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:58.587558 28577 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:58.588554 28577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "4727b465048b4ef593d2a10107088675"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "0c41bb9239f1393d904291845250c050"
server_key_iv: "a711f5be394d411f817f5155eba6e8aa"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.588871 28577 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "4727b465048b4ef593d2a10107088675"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "0c41bb9239f1393d904291845250c050"
server_key_iv: "a711f5be394d411f817f5155eba6e8aa"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.590098 28577 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:48:58.590847 28600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.591013 28577 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.591109 28577 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "4727b465048b4ef593d2a10107088675"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "0c41bb9239f1393d904291845250c050"
server_key_iv: "a711f5be394d411f817f5155eba6e8aa"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.591177 28577 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:58.605434 28577 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:58.607285 28577 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:58.607425 28577 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:58.607643 28577 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:58.607946 28577 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:58.607992 28577 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.608023 28577 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:58.608048 28577 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.614091 28577 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:35899
I20260810 14:48:58.614127 28790 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:35899 every 8 connection(s)
I20260810 14:48:58.614444 28577 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:58.622784 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28577
I20260810 14:48:58.622875 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:48:58.623078 19575 external_mini_cluster.cc:1428] Setting key 266b91b813db1317ba68bbae787aea7a
I20260810 14:48:58.623337 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.615167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:59207 (local address 127.19.29.254:40183)
0810 14:48:58.615226 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.615228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.615416 (+ 188us) server_negotiation.cc:407] Connection header received
0810 14:48:58.616281 (+ 865us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.616283 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.616294 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.616349 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.616889 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.617381 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.618386 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.618624 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.618692 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.620604 (+ 1912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.620605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.620605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.620612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.621852 (+ 1240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.622231 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.622249 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.622250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.622345 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.622665 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.622666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.622667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.622782 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.622844 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.623160 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.623267 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:48:58.623539 28793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.615107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:40183 (local address 127.19.29.193:59207)
0810 14:48:58.615273 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:58.615313 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:58.616191 (+ 878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:58.616402 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:58.616405 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:58.616640 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:58.616822 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.616826 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.617459 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.617459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.618268 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.618271 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.618708 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.618709 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.618812 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.619250 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:58.619258 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:58.620498 (+ 1240us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:58.621924 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.621931 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.621933 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.622150 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.622415 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.622416 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.622416 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.622522 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.622851 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:58.622858 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:58.623009 (+ 151us) client_negotiation.cc:769] Sending connection context
0810 14:48:58.623123 (+ 114us) client_negotiation.cc:240] Negotiation successful
0810 14:48:58.623284 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260810 14:48:58.623980 28791 heartbeater.cc:347] Connected to a master server at 127.19.29.254:40183
I20260810 14:48:58.624070 28791 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:58.624233 28791 heartbeater.cc:511] Master 127.19.29.254:40183 requested a full tablet report, sending...
I20260810 14:48:58.624787 28469 ts_manager.cc:194] Registered new tserver with Master: 4727b465048b4ef593d2a10107088675 (127.19.29.193:35899)
I20260810 14:48:58.625587 28469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:59207
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:48:58.646050 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:58.725337 28798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:58.725539 28798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:58.725561 28798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:58.726680 28798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:58.726713 28798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:58.726738 28798 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:48:58.728143 28798 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28798
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:58.728317 28798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:58.728493 28798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:58.733177 28808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:58.733270 28805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.733423 28798 server_base.cc:1034] running on GCE node
W20260810 14:48:58.733183 28806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.733670 28798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:58.733904 28798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:58.735047 28798 hybrid_clock.cc:648] HybridClock initialized: now 1786373338735037 us; error 27 us; skew 500 ppm
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.742511 28798 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:48:58.742895 28798 webserver.cc:460] Webserver started at http://127.19.29.194:34873/ using document root <none> and password file <none>
I20260810 14:48:58.743080 28798 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:58.743119 28798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:58.743213 28798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:58.744160 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "1877a520de064b5b943a3b636ce3e86c"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "b079bd63f56ea1af4d6a744d2053ef6c"
server_key_iv: "89aaa6a22412c5949cc5c0b35c31fb6e"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.744442 28798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "1877a520de064b5b943a3b636ce3e86c"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "b079bd63f56ea1af4d6a744d2053ef6c"
server_key_iv: "89aaa6a22412c5949cc5c0b35c31fb6e"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.745647 28798 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:48:58.746371 28816 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.746523 28798 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:48:58.746616 28798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "1877a520de064b5b943a3b636ce3e86c"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "b079bd63f56ea1af4d6a744d2053ef6c"
server_key_iv: "89aaa6a22412c5949cc5c0b35c31fb6e"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.746672 28798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:58.759117 28798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:58.760751 28798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:58.760854 28798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:58.761034 28798 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:58.761292 28798 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:58.761322 28798 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.761341 28798 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:58.761358 28798 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.766698 28798 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:42583
I20260810 14:48:58.766770 28989 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:42583 every 8 connection(s)
I20260810 14:48:58.767035 28798 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:48:58.770406 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28798
I20260810 14:48:58.770504 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:48:58.770700 19575 external_mini_cluster.cc:1428] Setting key 9a539749df448b8567405e670a79c546
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:58.776379 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.767732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:53213 (local address 127.19.29.254:40183)
0810 14:48:58.767782 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.767784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.767963 (+ 179us) server_negotiation.cc:407] Connection header received
0810 14:48:58.768932 (+ 969us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.768933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.768944 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.768993 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.769532 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.770025 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.771252 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.771472 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.771526 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.773638 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.773640 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.773640 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.773648 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.775003 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.775515 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.775517 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.775517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.775575 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.775825 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.775825 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.775826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.775921 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.775965 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.776257 (+ 292us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.776317 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:48:58.776654 28993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.767701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:40183 (local address 127.19.29.194:53213)
0810 14:48:58.767851 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:58.767886 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:58.768810 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:58.769052 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:58.769056 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:58.769291 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:58.769473 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.769477 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.770105 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.770106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.771191 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.771194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.771557 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.771558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.771688 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.772153 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:58.772160 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:58.773544 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:58.775085 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.775092 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.775095 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.775437 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.775634 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.775635 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.775636 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.775771 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.775972 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:58.775977 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:58.776132 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 14:48:58.776249 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 14:48:58.776416 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260810 14:48:58.777135 28991 heartbeater.cc:347] Connected to a master server at 127.19.29.254:40183
I20260810 14:48:58.777228 28991 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:58.777395 28991 heartbeater.cc:511] Master 127.19.29.254:40183 requested a full tablet report, sending...
I20260810 14:48:58.777768 28469 ts_manager.cc:194] Registered new tserver with Master: 1877a520de064b5b943a3b636ce3e86c (127.19.29.194:42583)
I20260810 14:48:58.778259 28469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:53213
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:48:58.795166 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:48:58.876039 28996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:48:58.876247 28996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:48:58.876283 28996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:48:58.877403 28996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:48:58.877446 28996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:48:58.877485 28996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:48:58.878975 28996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:40183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28996
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:48:58.879202 28996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:48:58.879410 28996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:48:58.884203 29004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:48:58.884231 29006 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.884298 28996 server_base.cc:1034] running on GCE node
W20260810 14:48:58.884219 29009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:48:58.884644 28996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:48:58.884882 28996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:48:58.886032 28996 hybrid_clock.cc:648] HybridClock initialized: now 1786373338886009 us; error 34 us; skew 500 ppm
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.888764 28996 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:48:58.889148 28996 webserver.cc:460] Webserver started at http://127.19.29.195:42967/ using document root <none> and password file <none>
I20260810 14:48:58.889308 28996 fs_manager.cc:359] Metadata directory not provided
I20260810 14:48:58.889346 28996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:48:58.889432 28996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:48:58.890403 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "e561caba874c4c7f8e199b6e030df81a"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "98ff70ae4308769d3e007644a03ba326"
server_key_iv: "e67e9ec6a7ff7cc8298ac5d037812bd4"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.890694 28996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "e561caba874c4c7f8e199b6e030df81a"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "98ff70ae4308769d3e007644a03ba326"
server_key_iv: "e67e9ec6a7ff7cc8298ac5d037812bd4"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.891821 28996 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:48:58.892424 29018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.892558 28996 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:48:58.892640 28996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "e561caba874c4c7f8e199b6e030df81a"
format_stamp: "Formatted at 2026-08-10 14:48:58 on dist-test-slave-4tdj"
server_key: "98ff70ae4308769d3e007644a03ba326"
server_key_iv: "e67e9ec6a7ff7cc8298ac5d037812bd4"
server_key_version: "encryptionkey@0"
I20260810 14:48:58.892695 28996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:48:58.901597 28996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:48:58.903160 28996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:48:58.903278 28996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:48:58.903460 28996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:48:58.903720 28996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:48:58.903759 28996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.903784 28996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:48:58.903808 28996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:48:58.909157 28996 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:37107
I20260810 14:48:58.909221 29205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:37107 every 8 connection(s)
I20260810 14:48:58.909472 28996 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:48:58.909807 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 28996
I20260810 14:48:58.909901 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:48:58.910105 19575 external_mini_cluster.cc:1428] Setting key b2d55a8469225cb7142a5c6e8a11890c
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:48:58.918094 28535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.910135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:39791 (local address 127.19.29.254:40183)
0810 14:48:58.910380 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.910382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.910433 (+ 51us) server_negotiation.cc:407] Connection header received
0810 14:48:58.911485 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.911486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.911496 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.911559 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.912097 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.912596 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.913489 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.913686 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.913736 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.915801 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.915803 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.915803 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.915810 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.916991 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.917317 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.917318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.917318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.917370 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.917558 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.917558 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.917558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.917650 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.917695 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.917958 (+ 263us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.918031 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214}
I20260810 14:48:58.918201 29208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.910130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:40183 (local address 127.19.29.195:39791)
0810 14:48:58.910315 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 14:48:58.910362 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 14:48:58.911390 (+ 1028us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:48:58.911617 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:48:58.911620 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:48:58.911846 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:48:58.912018 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.912022 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.912657 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.912658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.913419 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:48:58.913421 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.913777 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.913778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:48:58.913888 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.914401 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:48:58.914409 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:48:58.915721 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:48:58.917065 (+ 1344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.917068 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.917069 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.917258 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.917414 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:48:58.917415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:48:58.917415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:48:58.917498 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:48:58.917692 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:48:58.917696 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:48:58.917797 (+ 101us) client_negotiation.cc:769] Sending connection context
0810 14:48:58.917871 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:48:58.918002 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260810 14:48:58.918648 29206 heartbeater.cc:347] Connected to a master server at 127.19.29.254:40183
I20260810 14:48:58.918730 29206 heartbeater.cc:464] Registering TS with master...
I20260810 14:48:58.918895 29206 heartbeater.cc:511] Master 127.19.29.254:40183 requested a full tablet report, sending...
I20260810 14:48:58.919207 28469 ts_manager.cc:194] Registered new tserver with Master: e561caba874c4c7f8e199b6e030df81a (127.19.29.195:37107)
I20260810 14:48:58.919536 28469 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:39791
I20260810 14:48:58.921712 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/test-admin.keytab.
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.937494 19575 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260810 14:48:58.939043 29216 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:58.938333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.19.29.193:35899)
0810 14:48:58.938520 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.938525 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.938534 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:48:58.938559 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.938561 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.938572 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.938637 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.938969 (+ 332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52746: BlockingRecv error: recv got EOF from 127.0.0.1:52746 (error 108)
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
W20260810 14:48:58.939168 19575 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.940033 19575 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.940797 19575 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:58.947692 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.941254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52760 (local address 127.19.29.193:35899)
0810 14:48:58.941290 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.941292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.941320 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:48:58.941369 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.941370 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.941379 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.941420 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.941759 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.942507 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.943196 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.943515 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.943568 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.945336 (+ 1768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.945346 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.945346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.945353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.946803 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.947101 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.947103 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.947104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.947150 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.947273 (+ 123us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.947274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.947274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.947383 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.947479 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.947514 (+ 35us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.947595 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:48:58.949302 29216 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:58.948867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52770 (local address 127.19.29.193:35899)
0810 14:48:58.948943 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.948945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.948952 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:48:58.948990 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.948991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.948999 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.949039 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.949258 (+ 219us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52770: BlockingRecv error: recv got EOF from 127.0.0.1:52770 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260810 14:48:58.949361 19575 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.950233 19575 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.950980 19575 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:58.957013 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.951460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52786 (local address 127.19.29.193:35899)
0810 14:48:58.951499 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.951501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.951549 (+ 48us) server_negotiation.cc:407] Connection header received
0810 14:48:58.951595 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.951595 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.951603 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.951644 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.951996 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.952466 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.953078 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.953255 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.953297 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.955091 (+ 1794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.955092 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.955092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.955098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.956077 (+ 979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.956398 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.956399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.956399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.956445 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.956604 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.956605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.956605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.956689 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.956763 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.956873 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.956936 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 14:48:58.958330 29216 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:48:58.957912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52796 (local address 127.19.29.193:35899)
0810 14:48:58.957947 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.957949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.957978 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:48:58.958021 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.958022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.958028 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.958069 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.958263 (+ 194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52796: BlockingRecv error: recv got EOF from 127.0.0.1:52796 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260810 14:48:58.958416 19575 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786373310130398-19575-0/krb5kdc/krb5cc' of type FILE
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.959302 19575 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:48:58.959997 19575 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 10 14:48:58 dist-test-slave-4tdj krb5kdc[28395](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373338, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.193@KRBTEST.COM
I20260810 14:48:58.965788 29216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:48:58.960435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52800 (local address 127.19.29.193:35899)
0810 14:48:58.960477 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:48:58.960479 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:48:58.960534 (+ 55us) server_negotiation.cc:407] Connection header received
0810 14:48:58.960579 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:48:58.960580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:48:58.960586 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:48:58.960628 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:48:58.960912 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.961351 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.961983 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:48:58.962150 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:48:58.962188 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:48:58.963902 (+ 1714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:48:58.963903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:48:58.963904 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:48:58.963909 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:48:58.965044 (+ 1135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.965307 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.965308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.965308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.965351 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:48:58.965466 (+ 115us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:48:58.965467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:48:58.965467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:48:58.965541 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:48:58.965600 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:48:58.965668 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 14:48:58.965717 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 14:48:58.966377 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28577
I20260810 14:48:59.003473 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28798
I20260810 14:48:59.031083 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28996
I20260810 14:48:59.041592 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 28418
2026-08-10T14:48:59Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2032 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:48:59 dist-test-slave-4tdj krb5kdc[29232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:48:59 dist-test-slave-4tdj krb5kdc[29232](info): set up 2 sockets
Aug 10 14:48:59 dist-test-slave-4tdj krb5kdc[29232](info): commencing operation
krb5kdc: starting...
W20260810 14:49:00.207284 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:00Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab.
Entry for principal oryx/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab.
I20260810 14:49:00.319193 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:43431
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab
--principal=oryx/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:43431
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:00.399204 29254 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:00.399410 29254 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:00.399439 29254 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:00.400568 29254 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:00.400609 29254 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:00.400627 29254 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:00.400643 29254 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:00.400658 29254 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:00.402112 29254 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:43431
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab
--principal=oryx/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:43431
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:00.402370 29254 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:00.402581 29254 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:00.407219 29262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:00.407230 29267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.407356 29254 server_base.cc:1034] running on GCE node
W20260810 14:49:00.407238 29261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.407675 29254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:00.407944 29254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:00.409085 29254 hybrid_clock.cc:648] HybridClock initialized: now 1786373340409070 us; error 32 us; skew 500 ppm
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:00.411449 29254 init.cc:377] Logged in from keytab as oryx/127.19.29.254@KRBTEST.COM (short username oryx)
I20260810 14:49:00.411850 29254 webserver.cc:460] Webserver started at http://127.19.29.254:46407/ using document root <none> and password file <none>
I20260810 14:49:00.412042 29254 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:00.412088 29254 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:00.412217 29254 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:00.413257 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "689243c2b527411d94ff9949b3d2080f"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "c41749a4643b7c16009f86686eedd9ef"
server_key_iv: "4be6d28c923d4fa2aee436a2033e980a"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.413604 29254 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "689243c2b527411d94ff9949b3d2080f"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "c41749a4643b7c16009f86686eedd9ef"
server_key_iv: "4be6d28c923d4fa2aee436a2033e980a"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.414885 29254 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:00.415565 29280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.415711 29254 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:00.415798 29254 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "689243c2b527411d94ff9949b3d2080f"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "c41749a4643b7c16009f86686eedd9ef"
server_key_iv: "4be6d28c923d4fa2aee436a2033e980a"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.415854 29254 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:00.429733 29254 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:00.431565 29254 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:00.431703 29254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:00.435695 29254 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:43431
I20260810 14:49:00.435727 29358 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:43431 every 8 connection(s)
I20260810 14:49:00.436059 29254 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:00.437016 29361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:00.439369 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Bootstrap starting.
I20260810 14:49:00.439955 29361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:00.440223 29361 log.cc:824] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:00.440886 29361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: No bootstrap required, opened a new log
I20260810 14:49:00.442543 29361 raft_consensus.cc:348] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } }
I20260810 14:49:00.442690 29361 raft_consensus.cc:374] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:00.442721 29361 raft_consensus.cc:729] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689243c2b527411d94ff9949b3d2080f, State: Initialized, Role: FOLLOWER
I20260810 14:49:00.442867 29361 consensus_queue.cc:260] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } }
I20260810 14:49:00.442943 29361 raft_consensus.cc:388] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:00.442978 29361 raft_consensus.cc:482] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:00.443025 29361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:00.443827 29361 raft_consensus.cc:504] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } }
I20260810 14:49:00.443840 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 29254
I20260810 14:49:00.443934 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:00.443921 29361 leader_election.cc:302] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 689243c2b527411d94ff9949b3d2080f; no voters:
I20260810 14:49:00.444072 29361 leader_election.cc:288] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:00.444087 19575 external_mini_cluster.cc:1428] Setting key ee3d638e4e11563c2ab5ac4244c7f3c5
I20260810 14:49:00.444108 29365 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:00.444209 29365 raft_consensus.cc:686] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: Becoming Leader. State: Replica: 689243c2b527411d94ff9949b3d2080f, State: Running, Role: LEADER
I20260810 14:49:00.444293 29365 consensus_queue.cc:237] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } }
I20260810 14:49:00.444336 29361 sys_catalog.cc:564] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:00.444590 29365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } }
I20260810 14:49:00.444661 29365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:00.444764 29366 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 689243c2b527411d94ff9949b3d2080f. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } }
I20260810 14:49:00.444871 29376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:00.444897 29366 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:00.445451 29376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:00.447079 29376 catalog_manager.cc:1347] Generated new cluster ID: 30f1e1dd4fb8499899786635bc8744b5
I20260810 14:49:00.447132 29376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:00.453806 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.444533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38552 (local address 127.19.29.254:43431)
0810 14:49:00.444940 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:00.444952 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:00.444988 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:49:00.445110 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:00.445117 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:00.445176 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:00.445327 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:00.446356 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.447509 (+ 1153us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.448224 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.448663 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.448758 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.450928 (+ 2170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:00.450932 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:00.450932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:00.450944 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:00.452440 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.452756 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.452758 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.452758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.452860 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.453035 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.453036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.453036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.453265 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:00.453422 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:00.453490 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 14:49:00.453637 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":353,"thread_start_us":95,"threads_started":1}
I20260810 14:49:00.458822 29376 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:00.459322 29376 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:00.460964 29376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Generated new TSK 0
I20260810 14:49:00.461127 29376 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
I20260810 14:49:00.493220 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:00.609849 29401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:00.610062 29401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:00.610086 29401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:00.611274 29401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:00.611316 29401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:00.611342 29401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:00.612815 29401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:00.613050 29401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:00.613274 29401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:00.618189 29407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:00.618191 29411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.618319 29401 server_base.cc:1034] running on GCE node
W20260810 14:49:00.618254 29406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.618618 29401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:00.618857 29401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:00.619997 29401 hybrid_clock.cc:648] HybridClock initialized: now 1786373340619986 us; error 27 us; skew 500 ppm
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:00.622323 29401 init.cc:377] Logged in from keytab as oryx/127.19.29.193@KRBTEST.COM (short username oryx)
I20260810 14:49:00.622730 29401 webserver.cc:460] Webserver started at http://127.19.29.193:40081/ using document root <none> and password file <none>
I20260810 14:49:00.622924 29401 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:00.622972 29401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:00.623106 29401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:00.624117 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "c6ea52befe31461bba4057815b520204"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "e8038055a9d829ff595157d9c7db07eb"
server_key_iv: "4a448a006d34b0c9bb1318303ae393a9"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.624454 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "c6ea52befe31461bba4057815b520204"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "e8038055a9d829ff595157d9c7db07eb"
server_key_iv: "4a448a006d34b0c9bb1318303ae393a9"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.625689 29401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:00.626413 29422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.626549 29401 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:00.626633 29401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "c6ea52befe31461bba4057815b520204"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "e8038055a9d829ff595157d9c7db07eb"
server_key_iv: "4a448a006d34b0c9bb1318303ae393a9"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.626698 29401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:00.636479 29401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:00.638013 29401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:00.638137 29401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:00.638396 29401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:00.638681 29401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:00.638713 29401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.638739 29401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:00.638756 29401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.643986 29401 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41045
I20260810 14:49:00.644042 29617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41045 every 8 connection(s)
I20260810 14:49:00.644307 29401 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:00.649096 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 29401
I20260810 14:49:00.649202 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:00.649377 19575 external_mini_cluster.cc:1428] Setting key c229aa7f83f203d5737b7df3edf12dc1
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:00.652855 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.644924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:58363 (local address 127.19.29.254:43431)
0810 14:49:00.644965 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:00.644967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:00.645174 (+ 207us) server_negotiation.cc:407] Connection header received
0810 14:49:00.645747 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:00.645748 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:00.645761 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:00.645804 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:00.646709 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.647204 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.648121 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.648314 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.648356 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.650434 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:00.650435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:00.650435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:00.650441 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:00.651638 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.651983 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.651985 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.651985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.652052 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.652257 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.652258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.652259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.652369 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:00.652422 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:00.652681 (+ 259us) server_negotiation.cc:299] Negotiation successful
0810 14:49:00.652768 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:49:00.652987 29622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.644891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:58363)
0810 14:49:00.645042 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:00.645082 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:00.645639 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:00.645868 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:00.645871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:00.646452 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:00.646643 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.646648 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.647277 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.647278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.648058 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.648060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.648365 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.648366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.648454 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.648872 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:00.648880 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:00.650352 (+ 1472us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:00.651707 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.651715 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.651717 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.651917 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.652104 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.652105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.652105 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.652204 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.652423 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:00.652429 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:00.652562 (+ 133us) client_negotiation.cc:769] Sending connection context
0810 14:49:00.652646 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 14:49:00.652790 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260810 14:49:00.653492 29619 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:00.653591 29619 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:00.653756 29619 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
I20260810 14:49:00.654322 29306 ts_manager.cc:194] Registered new tserver with Master: c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
I20260810 14:49:00.655220 29306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:58363
WARNING: no policy specified for oryx/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
I20260810 14:49:00.673192 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:00.757712 29629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:00.757906 29629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:00.757928 29629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:00.759055 29629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:00.759089 29629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:00.759114 29629 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:00.760494 29629 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29629
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:00.760669 29629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:00.760844 29629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:00.765587 29640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:00.765594 29642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.765803 29629 server_base.cc:1034] running on GCE node
W20260810 14:49:00.765607 29638 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.766151 29629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:00.766439 29629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:00.767596 29629 hybrid_clock.cc:648] HybridClock initialized: now 1786373340767585 us; error 28 us; skew 500 ppm
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:00.769891 29629 init.cc:377] Logged in from keytab as oryx/127.19.29.194@KRBTEST.COM (short username oryx)
I20260810 14:49:00.770280 29629 webserver.cc:460] Webserver started at http://127.19.29.194:42205/ using document root <none> and password file <none>
I20260810 14:49:00.770509 29629 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:00.770558 29629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:00.770678 29629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:00.771693 29629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "b22907583d3f4e20bf51b8e6a4ce7e58"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "441744f331cf2065ceea972418d219f6"
server_key_iv: "a72673eecdf97c1cc574611d1d5e9d1e"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.772029 29629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "b22907583d3f4e20bf51b8e6a4ce7e58"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "441744f331cf2065ceea972418d219f6"
server_key_iv: "a72673eecdf97c1cc574611d1d5e9d1e"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.773227 29629 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:00.773886 29653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.774045 29629 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.774142 29629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "b22907583d3f4e20bf51b8e6a4ce7e58"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "441744f331cf2065ceea972418d219f6"
server_key_iv: "a72673eecdf97c1cc574611d1d5e9d1e"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.774200 29629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:00.780699 29629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:00.782259 29629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:00.782409 29629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:00.782617 29629 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:00.782891 29629 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:00.782922 29629 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.782949 29629 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:00.782974 29629 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.788527 29629 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:45035
I20260810 14:49:00.788564 29847 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:45035 every 8 connection(s)
I20260810 14:49:00.788856 29629 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:00.797289 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.789516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:48415 (local address 127.19.29.254:43431)
0810 14:49:00.789601 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:00.789603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:00.789743 (+ 140us) server_negotiation.cc:407] Connection header received
0810 14:49:00.790249 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:00.790250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:00.790264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:00.790347 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:00.791245 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.791745 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.792684 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.792871 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.792925 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.794948 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:00.794949 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:00.794950 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:00.794956 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:00.796040 (+ 1084us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.796412 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.796413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.796413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.796465 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.796685 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.796686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.796686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.796795 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:00.796850 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:00.797103 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 14:49:00.797190 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:49:00.797448 29851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.789471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:48415)
0810 14:49:00.789634 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:00.789671 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:00.790154 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:00.790419 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:00.790422 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:00.790958 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:00.791156 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.791161 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.791826 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.791827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.792605 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.792607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.792939 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.792939 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.793048 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.793493 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:00.793501 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:00.794857 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:00.796121 (+ 1264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.796128 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.796130 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.796344 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.796518 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.796518 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.796519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.796625 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.796850 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:00.796858 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:00.796984 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 14:49:00.797082 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:49:00.797230 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260810 14:49:00.797907 29848 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:00.797997 29848 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:00.798172 29848 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
I20260810 14:49:00.798194 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 29629
I20260810 14:49:00.798318 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:49:00.798524 19575 external_mini_cluster.cc:1428] Setting key 6e3d6ed91be50a4fe4c0bd0e32f833dc
I20260810 14:49:00.798588 29306 ts_manager.cc:194] Registered new tserver with Master: b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
I20260810 14:49:00.799015 29306 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:48415
WARNING: no policy specified for oryx/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
I20260810 14:49:00.822448 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:00.901880 29856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:00.902086 29856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:00.902108 29856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:00.903254 29856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:00.903294 29856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:00.903318 29856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:00.904772 29856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:00.904996 29856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:00.905228 29856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:00.909927 29864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:00.909979 29866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:00.909955 29870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:00.910166 29856 server_base.cc:1034] running on GCE node
I20260810 14:49:00.910382 29856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:00.910632 29856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:00.911777 29856 hybrid_clock.cc:648] HybridClock initialized: now 1786373340911763 us; error 30 us; skew 500 ppm
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:00.914109 29856 init.cc:377] Logged in from keytab as oryx/127.19.29.195@KRBTEST.COM (short username oryx)
I20260810 14:49:00.914531 29856 webserver.cc:460] Webserver started at http://127.19.29.195:33827/ using document root <none> and password file <none>
I20260810 14:49:00.914721 29856 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:00.914759 29856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:00.914848 29856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:00.915830 29856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "54c9a7289d294cf9adcd49949d57d61c"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "7182b379d4e2c35d04f122470a53fd8b"
server_key_iv: "94076a2032c568a58cad624cbc0c4b90"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.916108 29856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "54c9a7289d294cf9adcd49949d57d61c"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "7182b379d4e2c35d04f122470a53fd8b"
server_key_iv: "94076a2032c568a58cad624cbc0c4b90"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.917347 29856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:00.918017 29880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.918164 29856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:00.918247 29856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "54c9a7289d294cf9adcd49949d57d61c"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "7182b379d4e2c35d04f122470a53fd8b"
server_key_iv: "94076a2032c568a58cad624cbc0c4b90"
server_key_version: "encryptionkey@0"
I20260810 14:49:00.918335 29856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:00.936282 29856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:00.937954 29856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:00.938072 29856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:00.938251 29856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:00.938566 29856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:00.938609 29856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.938630 29856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:00.938645 29856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:00.943912 29856 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:33925
I20260810 14:49:00.944000 30082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:33925 every 8 connection(s)
I20260810 14:49:00.944271 29856 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:00.946979 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 29856
I20260810 14:49:00.947060 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:00.947227 19575 external_mini_cluster.cc:1428] Setting key 5ba89953fec8e9772edb086d2079d7a1
Aug 10 14:49:00 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:00.953101 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.944974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:56587 (local address 127.19.29.254:43431)
0810 14:49:00.945036 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:00.945038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:00.945263 (+ 225us) server_negotiation.cc:407] Connection header received
0810 14:49:00.945740 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:00.945742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:00.945752 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:00.945812 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:00.946822 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.947390 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.948518 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.948725 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.948778 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.950891 (+ 2113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:00.950892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:00.950893 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:00.950899 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:00.951977 (+ 1078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.952313 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.952313 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.952313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.952357 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:00.952555 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:00.952556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:00.952556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:00.952662 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:00.952708 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:00.952979 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 14:49:00.953037 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:49:00.953271 30085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:00.944937 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:56587)
0810 14:49:00.945140 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:00.945177 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:00.945662 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:00.945880 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:00.945884 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:00.946541 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:00.946732 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.946737 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.947478 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.947479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.948448 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:00.948451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:00.948786 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:00.948786 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:00.948886 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:00.949343 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:00.949351 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:00.950815 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:00.952045 (+ 1230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.952051 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.952053 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.952255 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.952401 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:00.952402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:00.952402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:00.952489 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:00.952737 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:00.952744 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:00.952862 (+ 118us) client_negotiation.cc:769] Sending connection context
0810 14:49:00.952956 (+ 94us) client_negotiation.cc:240] Negotiation successful
0810 14:49:00.953082 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260810 14:49:00.953678 30083 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:00.953760 30083 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:00.953919 30083 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
I20260810 14:49:00.954262 29305 ts_manager.cc:194] Registered new tserver with Master: 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925)
I20260810 14:49:00.954643 29305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:56587
I20260810 14:49:00.958771 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.29.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.253.keytab.
Entry for principal oryx/127.19.29.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.253.keytab.
I20260810 14:49:00.983112 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:38637
--webserver_interface=127.19.29.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.253.keytab
--principal=oryx/127.19.29.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:43431,127.19.29.253:38637
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:01.065757 30089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:01.065960 30089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:01.065981 30089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:01.067204 30089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:01.067247 30089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:01.067260 30089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:01.067271 30089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:01.067282 30089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:01.068804 30089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:43431,127.19.29.253:38637
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.253.keytab
--principal=oryx/127.19.29.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:38637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.29.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30089
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
W20260810 14:49:01.068912 30089 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.19.29.254:43431,127.19.29.253:38637'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260810 14:49:01.069058 30089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:01.069263 30089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.073987 30108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.074101 30089 server_base.cc:1034] running on GCE node
W20260810 14:49:01.074048 30100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.073993 30103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.074484 30089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.074771 30089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.075911 30089 hybrid_clock.cc:648] HybridClock initialized: now 1786373341075893 us; error 35 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.078330 30089 init.cc:377] Logged in from keytab as oryx/127.19.29.253@KRBTEST.COM (short username oryx)
I20260810 14:49:01.078738 30089 webserver.cc:460] Webserver started at http://127.19.29.253:40019/ using document root <none> and password file <none>
I20260810 14:49:01.078930 30089 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.078976 30089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.079102 30089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:01.080127 30089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/instance:
uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "3fbc74781c47399fbb794cf956e9c7f7"
server_key_iv: "718bcd53cee504063d3e0f2d9f2fe76b"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.080468 30089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal/instance:
uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "3fbc74781c47399fbb794cf956e9c7f7"
server_key_iv: "718bcd53cee504063d3e0f2d9f2fe76b"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.081765 30089 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:01.082428 30119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.082562 30089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:01.082648 30089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "3fbc74781c47399fbb794cf956e9c7f7"
server_key_iv: "718bcd53cee504063d3e0f2d9f2fe76b"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.082715 30089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.108845 30089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.111033 30089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:01.111169 30089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.115072 30089 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.253:38637
I20260810 14:49:01.115127 30205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.253:38637 every 8 connection(s)
I20260810 14:49:01.115463 30089 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
I20260810 14:49:01.116456 30206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:01.117770 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 30089
I20260810 14:49:01.118063 30206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.253@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.127530 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.118934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38564 (local address 127.19.29.254:43431)
0810 14:49:01.118984 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.118986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.119127 (+ 141us) server_negotiation.cc:407] Connection header received
0810 14:49:01.119319 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.119320 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.119331 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.119380 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.120126 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.120950 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.122135 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.122373 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.122448 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.124518 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.124520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.124520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.124528 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.126043 (+ 1515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.126542 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.126543 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.126544 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.126607 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.126859 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.126860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.126861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.127023 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.127083 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.127355 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.127440 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:49:01.127708 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.118868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38564)
0810 14:49:01.119016 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.119052 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.119238 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.119419 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.119421 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.119766 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.120004 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.120009 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.121053 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.121054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.122040 (+ 986us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.122043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.122454 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.122455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.122557 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.123060 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.123068 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.124436 (+ 1368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.126122 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.126128 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.126131 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.126457 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.126668 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.126669 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.126669 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.126805 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.127089 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.127096 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.127235 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.127322 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.127468 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260810 14:49:01.128059 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.118489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49474 (local address 127.19.29.253:38637)
0810 14:49:01.118672 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.118682 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.118714 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:49:01.119231 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.119240 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.119261 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.119363 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.120128 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.121332 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.122362 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.122743 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.122795 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.125060 (+ 2265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.125068 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.125069 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.125074 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.126706 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.127037 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.127041 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.127041 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.127150 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.127320 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.127321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.127321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.127454 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.127592 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.127904 (+ 312us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.127981 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":84,"threads_started":1}
I20260810 14:49:01.128471 30206 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.253@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.133919 30219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.128772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49476)
0810 14:49:01.128816 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.128826 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.128863 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.128965 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.128966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.129088 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.129115 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.129116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.129687 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.129688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.130151 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.130152 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.130532 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.130533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.130590 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.130878 (+ 288us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.130882 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.131929 (+ 1047us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.133083 (+ 1154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.133084 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.133085 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.133227 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.133382 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.133382 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.133383 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.133432 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.133634 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.133634 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.133670 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.133729 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.133820 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 14:49:01.133975 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.128817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49476 (local address 127.19.29.253:38637)
0810 14:49:01.128861 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.128862 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.128869 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:01.128913 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.128914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.128923 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.128964 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.129176 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.129624 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.130215 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.130473 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.130526 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.132013 (+ 1487us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.132015 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.132015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.132021 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.133012 (+ 991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.133282 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.133283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.133283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.133331 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.133480 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.133481 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.133481 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.133578 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.133632 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.133755 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.133868 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":30}
I20260810 14:49:01.135206 30206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Bootstrap starting.
I20260810 14:49:01.135991 30206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:01.136233 30206 log.cc:824] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:01.136895 30206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: No bootstrap required, opened a new log
I20260810 14:49:01.138244 30206 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } }
I20260810 14:49:01.138406 30206 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:01.138440 30206 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fe4fb84e9b94864b31b4a29f9b833a3, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.138538 30206 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } }
I20260810 14:49:01.138789 30221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } }
I20260810 14:49:01.138839 30206 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:01.138880 30221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:49:01.140421 30240 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:49:01.140477 30240 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:49:01.142163 30089 master_runner.cc:428] Detected that this master 1fe4fb84e9b94864b31b4a29f9b833a3 is joining an existing cluster
I20260810 14:49:01.142239 30089 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.29.253:38637
I20260810 14:49:01.150092 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.143387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49488)
0810 14:49:01.143526 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.143536 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.143599 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.143719 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.143720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.143936 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.143999 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.144001 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.144866 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.144867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.145803 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.145806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.146196 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.146197 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.146253 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.146676 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.146681 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.147115 (+ 434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.148748 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.148749 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.148749 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.148934 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.149372 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.149372 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.149373 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.149437 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.149740 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.149741 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.149788 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.149874 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.149983 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":76,"threads_started":1}
I20260810 14:49:01.150435 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.143456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49488 (local address 127.19.29.253:38637)
0810 14:49:01.143494 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.143496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.143598 (+ 102us) server_negotiation.cc:407] Connection header received
0810 14:49:01.143643 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.143644 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.143651 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.143707 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.144073 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.144780 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.145874 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.146103 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.146156 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.147200 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.147201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.147202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.147209 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.148676 (+ 1467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.149008 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.149010 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.149010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.149296 (+ 286us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.149534 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.149535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.149535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.149667 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.149741 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.149905 (+ 164us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.150082 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":22}
I20260810 14:49:01.151194 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.143259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38580 (local address 127.19.29.254:43431)
0810 14:49:01.143512 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.143514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.143521 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:01.143543 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.143544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.143554 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.143601 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.143983 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.144783 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.146835 (+ 2052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.147118 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.147190 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.148340 (+ 1150us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.148342 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.148342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.148349 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.149774 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.150371 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.150373 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.150373 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.150436 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.150758 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.150760 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.150760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.150889 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.150941 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.151073 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.151133 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230}
I20260810 14:49:01.151356 30253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.143175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38580)
0810 14:49:01.143303 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.143314 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.143363 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.143644 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.143645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.143847 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.143912 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.143914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.145898 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.145899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.146744 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.146748 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.147449 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.147450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.147527 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.147841 (+ 314us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.147846 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.148253 (+ 407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.149844 (+ 1591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.149845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.149845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.150127 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.150627 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.150628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.150628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.150689 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.150935 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.150935 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.150977 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.151055 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.151149 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.254@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.160794 30217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.153757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49498 (local address 127.19.29.253:38637)
0810 14:49:01.153796 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.153798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.153989 (+ 191us) server_negotiation.cc:407] Connection header received
0810 14:49:01.154023 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.154024 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.154033 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.154080 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.154637 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.155082 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.156194 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.156364 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.156406 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.158524 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.158526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.158527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.158533 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.159721 (+ 1188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.160078 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.160079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.160080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.160129 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.160293 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.160294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.160294 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.160391 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.160444 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.160634 (+ 190us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.160706 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:49:01.160820 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.153688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49498)
0810 14:49:01.153823 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.153878 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.153955 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.154095 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.154098 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.154470 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.154541 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.154543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.155154 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.155154 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.156112 (+ 958us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.156114 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.156421 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.156422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.156527 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.156923 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.156928 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.158444 (+ 1516us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.159799 (+ 1355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.159807 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.159810 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.160001 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.160184 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.160185 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.160185 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.160244 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.160458 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.160466 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.160520 (+ 54us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.160598 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.160715 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":69,"threads_started":1}
I20260810 14:49:01.161396 29305 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.29.253:38637: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
member_type: NON_VOTER
last_known_addr {
host: "127.19.29.253"
port: 38637
}
attrs {
promote: true
}
}
dest_uuid: "689243c2b527411d94ff9949b3d2080f"
cas_config_opid_index: -1
I20260810 14:49:01.161747 29305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } }
I20260810 14:49:01.162222 30259 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.162575 30169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:01.163136 30259 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.29.253:38637
I20260810 14:49:01.163362 30169 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260810 14:49:01.163527 30089 master.cc:537] Master@127.19.29.253:38637 shutting down...
I20260810 14:49:01.163538 30258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.163627 30258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.164023 30258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260810 14:49:01.164763 29284 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260810 14:49:01.165721 29284 consensus_peers.cc:487] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f -> Peer 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253:38637): Couldn't send request to peer 1fe4fb84e9b94864b31b4a29f9b833a3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 14:49:01.166479 30089 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:01.166569 30089 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:01.166620 30089 tablet_replica.cc:330] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: stopping tablet replica
I20260810 14:49:01.179953 30089 master.cc:552] Master@127.19.29.253:38637 shutdown complete.
I20260810 14:49:01.180009 30089 master_runner.cc:305] Clearing existing system tablet
I20260810 14:49:01.180137 30089 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.180187 30089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.180886 30089 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.002s
I20260810 14:49:01.181367 30265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.181520 30089 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.181578 30089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.181602 30089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "3fbc74781c47399fbb794cf956e9c7f7"
server_key_iv: "718bcd53cee504063d3e0f2d9f2fe76b"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.182402 30089 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:01.183898 30089 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 14:49:01.183977 30089 log.cc:1196] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260810 14:49:01.184170 30089 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Deleting consensus metadata
I20260810 14:49:01.184278 30089 master_runner.cc:315] Copying system tablet from 127.19.29.254:43431
I20260810 14:49:01.184830 30089 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: tablet copy: Beginning tablet copy session from remote peer at address 127.19.29.254:43431
I20260810 14:49:01.190539 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.185255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38596 (local address 127.19.29.254:43431)
0810 14:49:01.185300 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.185302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.185421 (+ 119us) server_negotiation.cc:407] Connection header received
0810 14:49:01.185491 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.185492 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.185502 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.185554 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.185867 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.186423 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.187129 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.187331 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.187387 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.188315 (+ 928us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.188316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.188317 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.188324 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.189497 (+ 1173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.189802 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.189803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.189804 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.189863 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.190023 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.190023 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.190024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.190142 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.190199 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.190357 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.190444 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:49:01.190567 30272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.185183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38596)
0810 14:49:01.185352 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.185362 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.185428 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.185558 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.185559 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.185741 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.185796 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.185798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.186490 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.186492 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.187053 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.187055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.187391 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.187392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.187457 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.187937 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.187941 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.188230 (+ 289us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.189577 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.189578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.189578 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.189742 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.189914 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.189915 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.189915 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.189973 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.190196 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.190197 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.190245 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.190333 (+ 88us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.190445 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":95,"threads_started":1}
I20260810 14:49:01.190860 29337 tablet_copy_service.cc:140] P 689243c2b527411d94ff9949b3d2080f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 1fe4fb84e9b94864b31b4a29f9b833a3 ({username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:38596)
I20260810 14:49:01.190999 29337 tablet_copy_service.cc:161] P 689243c2b527411d94ff9949b3d2080f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 1fe4fb84e9b94864b31b4a29f9b833a3 at {username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:38596: session id = 1fe4fb84e9b94864b31b4a29f9b833a3-00000000000000000000000000000000
I20260810 14:49:01.191751 29337 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 14:49:01.192322 30089 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 14:49:01.193320 30089 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: tablet copy: Starting download of 0 data blocks...
I20260810 14:49:01.193449 30089 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: tablet copy: Starting download of 1 WAL segments...
I20260810 14:49:01.194373 30089 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 14:49:01.195174 29337 tablet_copy_service.cc:342] P 689243c2b527411d94ff9949b3d2080f: Request end of tablet copy session 1fe4fb84e9b94864b31b4a29f9b833a3-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:38596
I20260810 14:49:01.195226 29337 tablet_copy_service.cc:433] P 689243c2b527411d94ff9949b3d2080f: ending tablet copy session 1fe4fb84e9b94864b31b4a29f9b833a3-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 1fe4fb84e9b94864b31b4a29f9b833a3
I20260810 14:49:01.197681 30089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.198746 30286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.198860 30089 server_base.cc:1034] running on GCE node
W20260810 14:49:01.198865 30276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.199122 30277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.199276 30089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.199415 30089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.200539 30089 hybrid_clock.cc:648] HybridClock initialized: now 1786373341200522 us; error 23 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.201785 30089 init.cc:377] Logged in from keytab as oryx/127.19.29.253@KRBTEST.COM (short username oryx)
I20260810 14:49:01.202049 30089 webserver.cc:460] Webserver started at http://127.19.29.253:40271/ using document root <none> and password file <none>
I20260810 14:49:01.202158 30089 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.202190 30089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.202869 30089 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.203390 30297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.203519 30089 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:01.203564 30089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "1fe4fb84e9b94864b31b4a29f9b833a3"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "3fbc74781c47399fbb794cf956e9c7f7"
server_key_iv: "718bcd53cee504063d3e0f2d9f2fe76b"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.203621 30089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.212517 30089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.213967 30089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.216821 30089 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.253:38637
I20260810 14:49:01.217170 30392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.253:38637 every 8 connection(s)
I20260810 14:49:01.217231 30089 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
I20260810 14:49:01.218046 30393 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:49:01.218531 30393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Bootstrap starting.
I20260810 14:49:01.220999 30393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:49:01.221252 30393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Bootstrap complete.
I20260810 14:49:01.221452 30393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } }
I20260810 14:49:01.221536 30393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 1fe4fb84e9b94864b31b4a29f9b833a3, State: Initialized, Role: LEARNER
I20260810 14:49:01.221575 30393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } }
I20260810 14:49:01.221746 30393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:01.221746 30396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.221855 30396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEARNER
I20260810 14:49:01.223133 30423 catalog_manager.cc:1259] Loaded cluster ID: 30f1e1dd4fb8499899786635bc8744b5
I20260810 14:49:01.223177 30423 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: loading cluster ID for follower catalog manager: success
I20260810 14:49:01.224296 30423 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: acquiring CA information for follower catalog manager: success
I20260810 14:49:01.224596 30423 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:49:01.236073 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.229474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49512 (local address 127.19.29.253:38637)
0810 14:49:01.229571 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.229573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.229582 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:01.229602 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.229603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.229612 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.229673 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.230433 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.231076 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.232101 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.232292 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.232335 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.233686 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.233688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.233688 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.233695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.235043 (+ 1348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.235413 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.235414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.235414 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.235459 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.235632 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.235633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.235633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.235724 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.235793 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.235936 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.235992 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":51,"threads_started":1}
WARNING: no policy specified for oryx/127.19.29.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.252.keytab.
Entry for principal oryx/127.19.29.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.252.keytab.
I20260810 14:49:01.261803 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:33561
--webserver_interface=127.19.29.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.252.keytab
--principal=oryx/127.19.29.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:01.346839 30427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:01.347047 30427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:01.347070 30427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:01.348188 30427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:01.348232 30427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:01.348248 30427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:01.348268 30427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:01.348282 30427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:01.349767 30427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.252.keytab
--principal=oryx/127.19.29.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:33561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.29.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:01.349968 30427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:01.350150 30427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.354758 30436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.354786 30434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.354785 30427 server_base.cc:1034] running on GCE node
W20260810 14:49:01.354766 30438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.355208 30427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.355477 30427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.356619 30427 hybrid_clock.cc:648] HybridClock initialized: now 1786373341356602 us; error 36 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.358965 30427 init.cc:377] Logged in from keytab as oryx/127.19.29.252@KRBTEST.COM (short username oryx)
I20260810 14:49:01.359341 30427 webserver.cc:460] Webserver started at http://127.19.29.252:45575/ using document root <none> and password file <none>
I20260810 14:49:01.359506 30427 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.359551 30427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.359638 30427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:01.360605 30427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/instance:
uuid: "3469dac0d8204045bfb92aa9cb5899fc"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "891c44c0d76fc292f8d96a2ce448ed92"
server_key_iv: "028e78343ef4ff182ffe691a20e41cde"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.360900 30427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal/instance:
uuid: "3469dac0d8204045bfb92aa9cb5899fc"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "891c44c0d76fc292f8d96a2ce448ed92"
server_key_iv: "028e78343ef4ff182ffe691a20e41cde"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.362041 30427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:49:01.362730 30458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.362886 30427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.362957 30427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "3469dac0d8204045bfb92aa9cb5899fc"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "891c44c0d76fc292f8d96a2ce448ed92"
server_key_iv: "028e78343ef4ff182ffe691a20e41cde"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.363026 30427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.375201 30427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.376878 30427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:01.376997 30427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.380914 30427 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.252:33561
I20260810 14:49:01.380954 30554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.252:33561 every 8 connection(s)
I20260810 14:49:01.381259 30427 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
I20260810 14:49:01.382179 30557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:01.383641 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:49:01.387367 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 30427
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.252@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:01.392624 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.384408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38610 (local address 127.19.29.254:43431)
0810 14:49:01.384472 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.384474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.384622 (+ 148us) server_negotiation.cc:407] Connection header received
0810 14:49:01.385059 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.385060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.385069 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.385119 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.385736 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.386207 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.387169 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.387448 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.387515 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.389911 (+ 2396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.389913 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.389913 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.389921 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.391410 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.391766 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.391768 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.391768 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.391822 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.392034 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.392035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.392035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.392143 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.392199 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.392467 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.392560 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:49:01.392796 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.384242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38610)
0810 14:49:01.384438 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.384483 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.384986 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.385181 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.385184 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.385423 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.385669 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.385675 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.386269 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.386270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.387097 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.387100 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.387535 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.387536 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.387641 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.388158 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.388166 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.389843 (+ 1677us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.391476 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.391483 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.391485 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.391699 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.391876 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.391876 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.391877 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.391978 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.392198 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.392204 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.392330 (+ 126us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.392428 (+ 98us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.392579 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":83,"threads_started":1}
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
I20260810 14:49:01.393446 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:49:01.396119 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.387864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40514 (local address 127.19.29.252:33561)
0810 14:49:01.387994 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.387999 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.388061 (+ 62us) server_negotiation.cc:407] Connection header received
0810 14:49:01.388128 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.388131 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.388149 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.388205 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.388852 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.389773 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.390740 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.391115 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.391170 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.393429 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.393434 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.393434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.393440 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.394998 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.395362 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.395364 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.395364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.395417 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.395622 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.395623 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.395624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.395748 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.395879 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.395949 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.396032 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":61,"threads_started":1}
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.252@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.399403 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.393704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49520)
0810 14:49:01.393750 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.393760 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.393797 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.393921 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.393922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.394068 (+ 146us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.394112 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.394113 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.394764 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.394765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.395399 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.395401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.395727 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.395728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.395792 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.396205 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.396210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.397334 (+ 1124us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.398563 (+ 1229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.398564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.398564 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.398707 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.398867 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.398868 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.398868 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.398919 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.399139 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.399140 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.399179 (+ 39us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.399237 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.399319 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:49:01.399422 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.393768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49520 (local address 127.19.29.253:38637)
0810 14:49:01.393820 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.393822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.393830 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:01.393855 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.393856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.393871 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.393920 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.394183 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.394696 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.395463 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.395672 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.395724 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.397409 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.397411 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.397411 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.397418 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.398492 (+ 1074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.398763 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.398764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.398765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.398817 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.398967 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.398968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.398969 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.399086 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.399139 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.399267 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.399341 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:49:01.399773 30557 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.252@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
I20260810 14:49:01.405031 30561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.399967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.0.0.1:40524)
0810 14:49:01.400010 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.400020 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.400052 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.400147 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.400147 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.400248 (+ 101us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.400274 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.400275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.400782 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.400782 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.401232 (+ 450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.401234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.401511 (+ 277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.401512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.401546 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.401850 (+ 304us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.401854 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.402891 (+ 1037us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.404088 (+ 1197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.404089 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.404090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.404265 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.404415 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.404415 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.404416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.404472 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.404764 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.404765 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.404802 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.404870 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.404946 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 14:49:01.405083 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.399997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40524 (local address 127.19.29.252:33561)
0810 14:49:01.400046 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.400047 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.400054 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:01.400087 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.400088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.400096 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.400139 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.400311 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.400731 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.401286 (+ 555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.401464 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.401507 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.402970 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.402971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.402971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.402977 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.403993 (+ 1016us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.404326 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.404326 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.404327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.404367 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.404564 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.404565 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.404566 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.404696 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.404757 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.404887 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.404997 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":46,"server-negotiator.queue_time_us":27}
I20260810 14:49:01.406270 30557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Bootstrap starting.
I20260810 14:49:01.407075 30557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:01.407301 30557 log.cc:824] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:01.408003 30557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: No bootstrap required, opened a new log
I20260810 14:49:01.409353 30557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } }
I20260810 14:49:01.409467 30557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:01.409488 30557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3469dac0d8204045bfb92aa9cb5899fc, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.409610 30557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } }
I20260810 14:49:01.409880 30557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:01.409849 30567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } } }
I20260810 14:49:01.409929 30567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:49:01.411405 30591 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:49:01.411463 30591 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:49:01.413478 30427 master_runner.cc:428] Detected that this master 3469dac0d8204045bfb92aa9cb5899fc is joining an existing cluster
I20260810 14:49:01.413537 30427 master_runner.cc:432] Initiating AddMaster RPC to add 127.19.29.252:33561
I20260810 14:49:01.420639 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40534 (local address 127.19.29.252:33561)
0810 14:49:01.414716 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.414718 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.414725 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:01.414742 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.414743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.414751 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.414793 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.415172 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.415890 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417053 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417319 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417366 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.418373 (+ 1007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.418375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.418375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.418381 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.419601 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.419961 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.419962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.419962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.420010 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.420162 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.420163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.420163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.420256 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.420307 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.420440 (+ 133us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.420562 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":64,"server-negotiator.queue_time_us":15}
I20260810 14:49:01.420650 30602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.0.0.1:40534)
0810 14:49:01.414646 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.414656 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.414704 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.414832 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.414833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.415024 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.415103 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.415105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.416088 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.416089 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.416969 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.416971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417421 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.417473 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.417883 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.417888 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.418272 (+ 384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.419673 (+ 1401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.419674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.419674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.419899 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.420060 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.420061 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.420061 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.420114 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.420307 (+ 193us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.420308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.420357 (+ 49us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.420415 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.420534 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":28,"thread_start_us":151,"threads_started":1}
I20260810 14:49:01.437861 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38624 (local address 127.19.29.254:43431)
0810 14:49:01.414541 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.414544 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.414830 (+ 286us) server_negotiation.cc:407] Connection header received
0810 14:49:01.414917 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.414918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.414928 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.414956 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.415306 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.416022 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417064 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417349 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417382 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.435166 (+ 17784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.435167 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.435168 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.435176 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.436654 (+ 1478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437047 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.437048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.437049 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.437108 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437307 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.437308 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.437308 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.437438 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.437481 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.437693 (+ 212us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.437774 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:49:01.438359 30607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38624)
0810 14:49:01.414779 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.414787 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.414851 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.415013 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.415013 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.415165 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.415229 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.415230 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.416101 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.416102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.416971 (+ 869us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.416972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417447 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.417509 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.434673 (+ 17164us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.434679 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.435075 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.436744 (+ 1669us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.436745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.436746 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.436952 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.437179 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.437180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.437238 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.437530 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.437531 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.437588 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.438167 (+ 579us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.438252 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":217,"mutex_wait_us":2,"thread_start_us":112,"threads_started":1}
I20260810 14:49:01.438534 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49524 (local address 127.19.29.253:38637)
0810 14:49:01.414833 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.414835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.415056 (+ 221us) server_negotiation.cc:407] Connection header received
0810 14:49:01.415146 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.415146 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.415156 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.415183 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.415588 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.416300 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417330 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417626 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417665 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.435363 (+ 17698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.435365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.435365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.435373 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.437371 (+ 1998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437736 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.437737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.437738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.437792 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437972 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.437973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.437973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.438105 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.438150 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.438372 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.438457 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:49:01.438535 30608 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.414869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49524)
0810 14:49:01.415001 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.415009 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.415079 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.415242 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.415242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.415426 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.415482 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.415483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.416392 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.416393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.417235 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.417237 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.417739 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.417740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.417798 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.434809 (+ 17011us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.434814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.435258 (+ 444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.437459 (+ 2201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437460 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.437460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.437653 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.437858 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.437858 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.437859 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.437910 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.438200 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.438201 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.438246 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.438335 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.438431 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373340, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.254@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
I20260810 14:49:01.446767 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.440453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.0.0.1:40546)
0810 14:49:01.440498 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.440508 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.440541 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.440689 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.440690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.440847 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.440891 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.440893 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.441428 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.441429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.442222 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.442225 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.442590 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.442591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.442657 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.442943 (+ 286us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.442948 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.444229 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.445759 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.445760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.445761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.445988 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.446168 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.446168 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.446169 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.446228 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.446511 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.446512 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.446569 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.446623 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.446699 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 14:49:01.446810 30562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.440543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.19.29.252:33561)
0810 14:49:01.440585 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.440586 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.440593 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:01.440624 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.440624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.440632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.440674 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.440949 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.441369 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.442331 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.442524 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.442580 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.444298 (+ 1718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.444299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.444300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.444305 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.445693 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.446066 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.446067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.446067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.446114 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.446328 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.446329 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.446329 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.446450 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.446517 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.446655 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.446727 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:49:01.447441 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 29401
I20260810 14:49:01.447424 29305 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.19.29.252:33561: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc"
member_type: NON_VOTER
last_known_addr {
host: "127.19.29.252"
port: 33561
}
attrs {
promote: true
}
}
dest_uuid: "689243c2b527411d94ff9949b3d2080f"
cas_config_opid_index: 5
I20260810 14:49:01.447647 29305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } }
I20260810 14:49:01.450286 30514 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:01.451344 30514 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 14:49:01.451258 30259 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.451601 30258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:01.452361 30259 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.19.29.252:33561
I20260810 14:49:01.452431 30259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.452490 30259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.452890 30514 raft_consensus.cc:858] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } }
W20260810 14:49:01.452975 30514 raft_consensus.cc:1565] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } }
I20260810 14:49:01.453567 30514 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.455299 30567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 689243c2b527411d94ff9949b3d2080f. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.455379 30567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 14:49:01.455415 30567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.455446 30567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 14:49:01.455470 30567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } }
I20260810 14:49:01.455498 30567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260810 14:49:01.456434 30258 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.456512 30258 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.457019 30511 raft_consensus.cc:1467] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20260810 14:49:01.457176 30511 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.457552 30427 master.cc:537] Master@127.19.29.252:33561 shutting down...
I20260810 14:49:01.457577 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.448051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49530)
0810 14:49:01.448245 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.448255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.448289 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.454434 (+ 6145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.454435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.454437 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:01.454474 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.454476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.455354 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.455355 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.456454 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.456457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.457324 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.457326 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.457388 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.457410 (+ 22us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.457461 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.457510 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260810 14:49:01.457818 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.448147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49530 (local address 127.19.29.253:38637)
0810 14:49:01.454200 (+ 6053us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.454202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.454211 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:01.454234 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.454235 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.454260 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.454357 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:01.454563 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.455259 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.456558 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.457132 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.457198 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.457285 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.457715 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.457755 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6029}
I20260810 14:49:01.458014 30352 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260810 14:49:01.458221 30259 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260810 14:49:01.458606 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:41045
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:43431
--webserver_port=40081
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:49:01.458822 30352 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.459473 30612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.459576 30612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: LEARNER
I20260810 14:49:01.459774 30396 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.459861 30396 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEARNER
I20260810 14:49:01.459793 30614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 689243c2b527411d94ff9949b3d2080f. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } }
I20260810 14:49:01.459914 30614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEARNER
I20260810 14:49:01.460108 30259 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: attempting to promote NON_VOTER 3469dac0d8204045bfb92aa9cb5899fc to VOTER
I20260810 14:49:01.460289 30259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:01.460779 30352 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260810 14:49:01.460963 30258 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260810 14:49:01.461683 30258 raft_consensus.cc:1013] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: attempt to promote peer 1fe4fb84e9b94864b31b4a29f9b833a3: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260810 14:49:01.462159 29281 consensus_peers.cc:487] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f -> Peer 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252:33561): Couldn't send request to peer 3469dac0d8204045bfb92aa9cb5899fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260810 14:49:01.462821 30427 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 LEARNER]: Raft consensus shutting down.
I20260810 14:49:01.462909 30427 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 LEARNER]: Raft consensus is shut down!
I20260810 14:49:01.462947 30427 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: stopping tablet replica
I20260810 14:49:01.477612 30427 master.cc:552] Master@127.19.29.252:33561 shutdown complete.
I20260810 14:49:01.477667 30427 master_runner.cc:305] Clearing existing system tablet
I20260810 14:49:01.477785 30427 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.477833 30427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.478600 30427 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.479146 30630 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.479291 30427 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.479358 30427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:01.479384 30427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "3469dac0d8204045bfb92aa9cb5899fc"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "891c44c0d76fc292f8d96a2ce448ed92"
server_key_iv: "028e78343ef4ff182ffe691a20e41cde"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.480082 30427 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:01.481778 30427 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260810 14:49:01.481853 30427 log.cc:1196] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260810 14:49:01.482110 30427 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Deleting consensus metadata
I20260810 14:49:01.482236 30427 master_runner.cc:315] Copying system tablet from 127.19.29.254:43431
I20260810 14:49:01.482872 30427 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: tablet copy: Beginning tablet copy session from remote peer at address 127.19.29.254:43431
I20260810 14:49:01.489725 30639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.483160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:38640)
0810 14:49:01.483343 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.483354 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.483427 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.483566 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.483567 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.483760 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.483830 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.483833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.484741 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.484742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.485537 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.485540 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.486000 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.486001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.486066 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.486547 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.486552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.486944 (+ 392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.488655 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.488657 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.488657 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.488866 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.489071 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.489072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.489072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.489140 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.489386 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.489387 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.489455 (+ 68us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.489526 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.489627 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":65,"threads_started":1}
I20260810 14:49:01.489727 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.483233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38640 (local address 127.19.29.254:43431)
0810 14:49:01.483280 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.483282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.483430 (+ 148us) server_negotiation.cc:407] Connection header received
0810 14:49:01.483487 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.483489 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.483502 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.483561 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.483901 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.484664 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.485619 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.485914 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.485979 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.487034 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.487035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.487036 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.487044 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.488571 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.488938 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.488938 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.488939 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.489003 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.489201 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.489202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.489202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.489323 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.489386 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.489564 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.489642 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:49:01.490346 29337 tablet_copy_service.cc:140] P 689243c2b527411d94ff9949b3d2080f: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3469dac0d8204045bfb92aa9cb5899fc ({username='oryx', principal='oryx/127.19.29.252@KRBTEST.COM'} at 127.0.0.1:38640)
I20260810 14:49:01.490404 29337 tablet_copy_service.cc:161] P 689243c2b527411d94ff9949b3d2080f: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3469dac0d8204045bfb92aa9cb5899fc at {username='oryx', principal='oryx/127.19.29.252@KRBTEST.COM'} at 127.0.0.1:38640: session id = 3469dac0d8204045bfb92aa9cb5899fc-00000000000000000000000000000000
I20260810 14:49:01.490984 29337 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Tablet Copy: opened 0 blocks and 1 log segments
I20260810 14:49:01.491509 30427 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260810 14:49:01.492645 30427 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: tablet copy: Starting download of 0 data blocks...
I20260810 14:49:01.492771 30427 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: tablet copy: Starting download of 1 WAL segments...
I20260810 14:49:01.493563 30427 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260810 14:49:01.494504 29337 tablet_copy_service.cc:342] P 689243c2b527411d94ff9949b3d2080f: Request end of tablet copy session 3469dac0d8204045bfb92aa9cb5899fc-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.19.29.252@KRBTEST.COM'} at 127.0.0.1:38640
I20260810 14:49:01.494555 29337 tablet_copy_service.cc:433] P 689243c2b527411d94ff9949b3d2080f: ending tablet copy session 3469dac0d8204045bfb92aa9cb5899fc-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3469dac0d8204045bfb92aa9cb5899fc
I20260810 14:49:01.497032 30427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.498159 30646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.498334 30640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.498543 30642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.502472 30427 server_base.cc:1034] running on GCE node
I20260810 14:49:01.502583 30427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.502724 30427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.503854 30427 hybrid_clock.cc:648] HybridClock initialized: now 1786373341503835 us; error 37 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.505462 30427 init.cc:377] Logged in from keytab as oryx/127.19.29.252@KRBTEST.COM (short username oryx)
I20260810 14:49:01.505764 30427 webserver.cc:460] Webserver started at http://127.19.29.252:36929/ using document root <none> and password file <none>
I20260810 14:49:01.505880 30427 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.505918 30427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.506667 30427 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:01.507213 30657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.507370 30427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:01.507424 30427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "3469dac0d8204045bfb92aa9cb5899fc"
format_stamp: "Formatted at 2026-08-10 14:49:01 on dist-test-slave-4tdj"
server_key: "891c44c0d76fc292f8d96a2ce448ed92"
server_key_iv: "028e78343ef4ff182ffe691a20e41cde"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.507483 30427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.516893 30427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.518543 30427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.521513 30427 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.252:33561
I20260810 14:49:01.521605 30752 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.252:33561 every 8 connection(s)
I20260810 14:49:01.521839 30427 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
I20260810 14:49:01.522836 30753 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:49:01.523453 30753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Bootstrap starting.
I20260810 14:49:01.525758 30753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260810 14:49:01.526072 30753 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: Bootstrap complete.
I20260810 14:49:01.526392 30753 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 LEARNER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } }
I20260810 14:49:01.526619 30753 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3469dac0d8204045bfb92aa9cb5899fc, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.526710 30753 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:01.527020 30753 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:01.527030 30757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.527199 30757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:01.528744 30779 catalog_manager.cc:1259] Loaded cluster ID: 30f1e1dd4fb8499899786635bc8744b5
I20260810 14:49:01.528790 30779 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: loading cluster ID for follower catalog manager: success
I20260810 14:49:01.529830 30779 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: acquiring CA information for follower catalog manager: success
I20260810 14:49:01.530133 30779 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260810 14:49:01.557946 30616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:01.558143 30616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:01.558176 30616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:01.559369 30616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:01.559410 30616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:01.559444 30616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:01.560895 30616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:41045
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=40081
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:01.561113 30616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:01.561326 30616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.566154 30786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.566154 30785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.566192 30791 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.566419 30616 server_base.cc:1034] running on GCE node
I20260810 14:49:01.566648 30616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.566896 30616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.568033 30616 hybrid_clock.cc:648] HybridClock initialized: now 1786373341568020 us; error 30 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.570405 30616 init.cc:377] Logged in from keytab as oryx/127.19.29.193@KRBTEST.COM (short username oryx)
I20260810 14:49:01.570812 30616 webserver.cc:460] Webserver started at http://127.19.29.193:40081/ using document root <none> and password file <none>
I20260810 14:49:01.570982 30616 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.571034 30616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.572260 30616 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:01.572798 30806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.572937 30616 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:01.573019 30616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "c6ea52befe31461bba4057815b520204"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "e8038055a9d829ff595157d9c7db07eb"
server_key_iv: "4a448a006d34b0c9bb1318303ae393a9"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.573349 30616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.581545 30616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.583199 30616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:01.583297 30616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.583458 30616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:01.583690 30616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:01.583719 30616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.583735 30616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:01.583751 30616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.589536 30616 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41045
I20260810 14:49:01.589658 31029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41045 every 8 connection(s)
I20260810 14:49:01.589900 30616 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:01.595260 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 30616
I20260810 14:49:01.595422 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 29629
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:01.605338 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.590622 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:46249 (local address 127.19.29.254:43431)
0810 14:49:01.590678 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.590681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.590972 (+ 291us) server_negotiation.cc:407] Connection header received
0810 14:49:01.592014 (+ 1042us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.592016 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.592027 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.592071 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.592774 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593275 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594581 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.594770 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594824 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.600392 (+ 5568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.600394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.600394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.600404 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.603834 (+ 3430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.604315 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.604317 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.604317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.604370 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.604591 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.604592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.604592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.604704 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.604752 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.605149 (+ 397us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.605247 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:49:01.606184 31038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.590605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:46249)
0810 14:49:01.590794 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.590832 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.591844 (+ 1012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.592127 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.592128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.592465 (+ 337us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.592676 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.592678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593378 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.593379 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.594485 (+ 1106us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.594488 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.594843 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.594985 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.598084 (+ 3099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.598097 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.600260 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.603917 (+ 3657us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.603924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.603927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.604240 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.604423 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.604423 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.604423 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.604539 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.604874 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.604879 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.605029 (+ 150us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.605767 (+ 738us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.605947 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":25,"thread_start_us":107,"threads_started":1}
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.606968 31031 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:01.607065 31031 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.607260 31031 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
I20260810 14:49:01.607684 29305 ts_manager.cc:194] Re-registered known tserver with Master: c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
I20260810 14:49:01.608173 29305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:46249
I20260810 14:49:01.616699 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.590666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:33117 (local address 127.19.29.252:33561)
0810 14:49:01.591031 (+ 365us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.591033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.591043 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:01.591951 (+ 908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.591952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.591968 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.592034 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.592767 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593734 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594546 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.594862 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594928 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.608396 (+ 13468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.608398 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.608399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.608408 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.615204 (+ 6796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.615791 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.615793 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.615793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.615855 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.616058 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.616060 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.616060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.616220 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.616295 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.616511 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.616608 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":52,"threads_started":1}
I20260810 14:49:01.617125 31037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.590605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.19.29.193:33117)
0810 14:49:01.590792 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.590832 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.591840 (+ 1008us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.592121 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.592125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.592483 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.592673 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.592677 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593801 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.593802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.594470 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.594472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.594926 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.594994 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.606526 (+ 11532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.606531 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.608295 (+ 1764us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.615291 (+ 6996us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.615293 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.615293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.615718 (+ 425us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.615911 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.615912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.615913 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.615975 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.616330 (+ 355us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.616331 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.616378 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.616831 (+ 453us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.616947 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260810 14:49:01.617699 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.591015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:51413 (local address 127.19.29.253:38637)
0810 14:49:01.591084 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.591086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.591145 (+ 59us) server_negotiation.cc:407] Connection header received
0810 14:49:01.591953 (+ 808us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.591954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.591966 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.591996 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.592787 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593530 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594596 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.594869 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.594927 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.615125 (+ 20198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.615127 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.615128 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.615138 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.616584 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.616938 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.616939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.616939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.617008 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.617172 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.617173 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.617173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.617324 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.617379 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.617536 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.617613 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 14:49:01.617727 31040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.590907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.19.29.193:51413)
0810 14:49:01.591098 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.591107 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.591852 (+ 745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.592127 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.592128 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.592483 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.592676 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.592678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.593609 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.593610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.594490 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.594492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.595204 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.595205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.595246 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.605300 (+ 10054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.605304 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.608017 (+ 2713us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.616660 (+ 8643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.616661 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.616661 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.616854 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.617071 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.617071 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.617072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.617115 (+ 43us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.617405 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.617405 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.617438 (+ 33us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.617500 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.617612 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"mutex_wait_us":8,"thread_start_us":63,"threads_started":1}
I20260810 14:49:01.618130 31034 heartbeater.cc:347] Connected to a master server at 127.19.29.253:38637
I20260810 14:49:01.618198 31034 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.618319 31034 heartbeater.cc:511] Master 127.19.29.253:38637 requested a full tablet report, sending...
I20260810 14:49:01.618736 30331 ts_manager.cc:194] Registered new tserver with Master: c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
I20260810 14:49:01.619951 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:45035
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:43431
--webserver_port=42205
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:49:01.620054 31032 heartbeater.cc:347] Connected to a master server at 127.19.29.252:33561
I20260810 14:49:01.620107 31032 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.620157 31032 heartbeater.cc:511] Master 127.19.29.252:33561 requested a full tablet report, sending...
I20260810 14:49:01.620527 30677 ts_manager.cc:194] Registered new tserver with Master: c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
W20260810 14:49:01.717213 31043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:01.717412 31043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:01.717437 31043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:01.718595 31043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:01.718640 31043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:01.718667 31043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:01.720268 31043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:45035
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=42205
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:01.720523 31043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:01.720732 31043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.725965 31051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.726017 31057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.726027 31052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.726257 31043 server_base.cc:1034] running on GCE node
I20260810 14:49:01.726465 31043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.726696 31043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.727830 31043 hybrid_clock.cc:648] HybridClock initialized: now 1786373341727814 us; error 31 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.730273 31043 init.cc:377] Logged in from keytab as oryx/127.19.29.194@KRBTEST.COM (short username oryx)
I20260810 14:49:01.730773 31043 webserver.cc:460] Webserver started at http://127.19.29.194:42205/ using document root <none> and password file <none>
I20260810 14:49:01.730990 31043 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.731055 31043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.732333 31043 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:01.732985 31067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.733172 31043 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:01.733266 31043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "b22907583d3f4e20bf51b8e6a4ce7e58"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "441744f331cf2065ceea972418d219f6"
server_key_iv: "a72673eecdf97c1cc574611d1d5e9d1e"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.733608 31043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.743695 31043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.745872 31043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:01.746019 31043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.746232 31043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:01.746577 31043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:01.746624 31043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.746656 31043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:01.746685 31043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.753674 31043 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:45035
I20260810 14:49:01.753717 31269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:45035 every 8 connection(s)
I20260810 14:49:01.754055 31043 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:49:01.755530 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 31043
I20260810 14:49:01.755657 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 29856
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:01.772195 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.754825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:39797 (local address 127.19.29.252:33561)
0810 14:49:01.754870 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.754873 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.755067 (+ 194us) server_negotiation.cc:407] Connection header received
0810 14:49:01.757431 (+ 2364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.757433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.757450 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.757490 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.757802 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.758477 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.759939 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.760232 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.760275 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.768848 (+ 8573us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.768850 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.768850 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.768858 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.770607 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771096 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.771097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.771097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.771159 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771443 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.771444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.771445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.771593 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.771636 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.772003 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.772098 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:01.772266 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.754762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:56569 (local address 127.19.29.254:43431)
0810 14:49:01.755009 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.755011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.755231 (+ 220us) server_negotiation.cc:407] Connection header received
0810 14:49:01.756534 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.756536 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.756550 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.756581 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.758438 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.759162 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.760153 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.760415 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.760459 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.769412 (+ 8953us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.769414 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.769415 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.769423 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.771172 (+ 1749us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771522 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.771523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.771524 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.771573 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771761 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.771761 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.771762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.771880 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.771920 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.772120 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.772190 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215}
I20260810 14:49:01.772675 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:33925
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:43431
--webserver_port=33827
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37973
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:49:01.772921 31282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.754765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.19.29.194:39797)
0810 14:49:01.754938 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.754979 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.756353 (+ 1374us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.757550 (+ 1197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.757550 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.757685 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.757735 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.757737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.758613 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.758614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.759831 (+ 1217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.759834 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.760368 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.760369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.760523 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.762872 (+ 2349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.762883 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.768736 (+ 5853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.770701 (+ 1965us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.770711 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.770714 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.771002 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.771231 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771232 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.771232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.771364 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.771679 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.771687 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.771855 (+ 168us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.772547 (+ 692us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.772702 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":94,"threads_started":1}
I20260810 14:49:01.773356 31272 heartbeater.cc:347] Connected to a master server at 127.19.29.252:33561
I20260810 14:49:01.773365 31283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.754765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:56569)
0810 14:49:01.755165 (+ 400us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.755176 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.756439 (+ 1263us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.756769 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.756773 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.757079 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.757320 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.757325 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.759274 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.759275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.760059 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.760061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.760543 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.760543 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.760599 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.763631 (+ 3032us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.763636 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.769298 (+ 5662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.771269 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.771270 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.771444 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.771641 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.771642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.771642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.771695 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.771965 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.771965 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.772000 (+ 35us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.772381 (+ 381us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.773247 (+ 866us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":3,"thread_start_us":95,"threads_started":1}
I20260810 14:49:01.773464 31272 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.773933 31272 heartbeater.cc:511] Master 127.19.29.252:33561 requested a full tablet report, sending...
I20260810 14:49:01.774384 31270 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:01.774462 31270 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.774479 30677 ts_manager.cc:194] Registered new tserver with Master: b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
I20260810 14:49:01.774533 31270 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
I20260810 14:49:01.774784 29305 ts_manager.cc:194] Re-registered known tserver with Master: b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
I20260810 14:49:01.775247 29305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:56569
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
I20260810 14:49:01.779397 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.755140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:44063 (local address 127.19.29.253:38637)
0810 14:49:01.755196 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.755197 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.755305 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:49:01.770175 (+ 14870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.770177 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.770194 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.770227 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.770933 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.771618 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.772901 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.773181 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.773231 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.777098 (+ 3867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.777099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.777100 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.777107 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.778413 (+ 1306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.778772 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.778773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.778773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.778827 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.778990 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.778991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.778991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.779086 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.779135 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.779277 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.779336 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:49:01.779482 31281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.755067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.19.29.194:44063)
0810 14:49:01.755253 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.755261 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.770045 (+ 14784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.770326 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.770327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.770599 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.770817 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.770820 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.771737 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.771738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.772784 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.772788 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.773317 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.773318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.773448 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.773887 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.773893 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.777008 (+ 3115us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.778488 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.778489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.778490 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.778699 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.778880 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.778880 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.778881 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.778942 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.779140 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.779141 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.779183 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.779252 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.779363 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":60,"threads_started":1}
I20260810 14:49:01.779947 31278 heartbeater.cc:347] Connected to a master server at 127.19.29.253:38637
I20260810 14:49:01.780010 31278 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.780083 31278 heartbeater.cc:511] Master 127.19.29.253:38637 requested a full tablet report, sending...
I20260810 14:49:01.780407 30331 ts_manager.cc:194] Registered new tserver with Master: b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
W20260810 14:49:01.856145 31284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:01.856335 31284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:01.856356 31284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:01.857426 31284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:01.857457 31284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:01.857481 31284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:01.858915 31284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37973
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:33925
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=33827
--tserver_master_addrs=127.19.29.254:43431,127.19.29.253:38637,127.19.29.252:33561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:01.859102 31284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:01.859272 31284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:01.864189 31291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:01.864184 31290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.864348 31284 server_base.cc:1034] running on GCE node
W20260810 14:49:01.864452 31294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:01.864660 31284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:01.864876 31284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:01.866079 31284 hybrid_clock.cc:648] HybridClock initialized: now 1786373341866060 us; error 34 us; skew 500 ppm
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:01.868503 31284 init.cc:377] Logged in from keytab as oryx/127.19.29.195@KRBTEST.COM (short username oryx)
I20260810 14:49:01.868868 31284 webserver.cc:460] Webserver started at http://127.19.29.195:33827/ using document root <none> and password file <none>
I20260810 14:49:01.869037 31284 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:01.869087 31284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:01.870349 31284 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:01.870872 31305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.871011 31284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.871095 31284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "54c9a7289d294cf9adcd49949d57d61c"
format_stamp: "Formatted at 2026-08-10 14:49:00 on dist-test-slave-4tdj"
server_key: "7182b379d4e2c35d04f122470a53fd8b"
server_key_iv: "94076a2032c568a58cad624cbc0c4b90"
server_key_version: "encryptionkey@0"
I20260810 14:49:01.871394 31284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:01.886919 31284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:01.888878 31284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:01.888991 31284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:01.889168 31284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:01.889436 31284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:01.889467 31284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.889496 31284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:01.889518 31284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:01.895447 31284 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:33925
I20260810 14:49:01.895653 31514 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:33925 every 8 connection(s)
I20260810 14:49:01.895900 31284 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:01.898913 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 31284
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.253@KRBTEST.COM
Aug 10 14:49:01 dist-test-slave-4tdj krb5kdc[29232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373341, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.252@KRBTEST.COM
I20260810 14:49:01.908641 31039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.896587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:58271 (local address 127.19.29.252:33561)
0810 14:49:01.896636 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.896639 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.896901 (+ 262us) server_negotiation.cc:407] Connection header received
0810 14:49:01.897905 (+ 1004us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.897907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.897921 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.897969 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.898756 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899493 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.900959 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901262 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901297 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.905923 (+ 4626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.905924 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.905925 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.905932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.907359 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907701 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.907702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.907703 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.907753 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907943 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.907944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.907945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.908056 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.908098 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.908465 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.908559 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:49:01.908641 30424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.896739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:45727 (local address 127.19.29.253:38637)
0810 14:49:01.897013 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.897014 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.897023 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:01.897924 (+ 901us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.897925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.897937 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.897968 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.898793 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899531 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.900957 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901254 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901293 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.904640 (+ 3347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.904641 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.904641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.904648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.907126 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907625 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.907626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.907627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.907681 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907936 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.907937 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.907937 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.908065 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.908100 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.908486 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.908547 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242}
I20260810 14:49:01.909158 31524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.896577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.19.29.195:58271)
0810 14:49:01.896763 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.896807 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.897801 (+ 994us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.898051 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.898055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.898435 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.898666 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.898671 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899625 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.899626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.900856 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.900859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901379 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.901519 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.902148 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.902160 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.905826 (+ 3666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.907437 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.907438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.907626 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.907821 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907821 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.907822 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.907877 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.908145 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.908154 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.908312 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.908730 (+ 418us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.908926 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"mutex_wait_us":13,"thread_start_us":96,"threads_started":1}
I20260810 14:49:01.909158 31527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.896578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.19.29.195:45727)
0810 14:49:01.896799 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.896809 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.897799 (+ 990us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.898050 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.898055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.898443 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.898667 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.898674 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899626 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.899627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.900860 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.900863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901381 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.901520 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.902373 (+ 853us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.902377 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.904560 (+ 2183us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.907220 (+ 2660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907228 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.907230 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.907547 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.907743 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.907744 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.907744 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.907862 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.908146 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.908154 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.908312 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.908747 (+ 435us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.908968 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":382,"spinlock_wait_cycles":7424,"thread_start_us":133,"threads_started":1}
I20260810 14:49:01.909778 31518 heartbeater.cc:347] Connected to a master server at 127.19.29.252:33561
I20260810 14:49:01.909878 31518 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.910081 31518 heartbeater.cc:511] Master 127.19.29.252:33561 requested a full tablet report, sending...
I20260810 14:49:01.910378 31520 heartbeater.cc:347] Connected to a master server at 127.19.29.253:38637
I20260810 14:49:01.910435 31520 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.910645 30677 ts_manager.cc:194] Registered new tserver with Master: 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925)
I20260810 14:49:01.910722 31520 heartbeater.cc:511] Master 127.19.29.253:38637 requested a full tablet report, sending...
I20260810 14:49:01.910766 29374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.897121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:38961 (local address 127.19.29.254:43431)
0810 14:49:01.897192 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.897194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.897204 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:01.897923 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.897924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.897937 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.897968 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.898771 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899540 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.900959 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901249 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901287 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.904639 (+ 3352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.904641 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.904641 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.904648 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.908317 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.909120 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.909121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.909122 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.909799 (+ 677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.910090 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.910091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.910091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.910216 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.910259 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.910609 (+ 350us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.910685 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:49:01.911172 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.896897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:38961)
0810 14:49:01.897016 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.897025 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.897812 (+ 787us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.898050 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.898055 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.898458 (+ 403us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:01.898667 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.898674 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.899626 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.899627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.900856 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.900859 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.901377 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.901378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.901519 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.902221 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:01.902225 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:01.904524 (+ 2299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:01.908404 (+ 3880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.908405 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.908406 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.908634 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.909949 (+ 1315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:01.909950 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:01.909950 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:01.910014 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:01.910371 (+ 357us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:01.910372 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:01.910413 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.911023 (+ 610us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.911105 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":132,"thread_start_us":59,"threads_started":1}
I20260810 14:49:01.911255 30331 ts_manager.cc:194] Registered new tserver with Master: 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925)
I20260810 14:49:01.911702 31517 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43431
I20260810 14:49:01.911757 31517 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:01.911818 31517 heartbeater.cc:511] Master 127.19.29.254:43431 requested a full tablet report, sending...
I20260810 14:49:01.912031 29305 ts_manager.cc:194] Re-registered known tserver with Master: 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925)
I20260810 14:49:01.912462 29305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:38961
I20260810 14:49:01.912683 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.900277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38648 (local address 127.19.29.254:43431)
0810 14:49:01.901300 (+ 1023us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.901302 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.901308 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:49:01.901328 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.901329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.901339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.901402 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.902345 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.903011 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.905012 (+ 2001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.905333 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.905399 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.906789 (+ 1390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.906790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.906791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.906797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.910288 (+ 3491us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.911766 (+ 1478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.911767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.911767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.911823 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.911999 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.912000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.912001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.912130 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.912225 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.912466 (+ 241us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.912600 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":993,"thread_start_us":82,"threads_started":1}
I20260810 14:49:01.913249 31539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.900037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40558 (local address 127.19.29.252:33561)
0810 14:49:01.902954 (+ 2917us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.902956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.902964 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:01.902995 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.902996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.903007 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.903068 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.903738 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.904769 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.908524 (+ 3755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.908875 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.908925 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.910252 (+ 1327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.910254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.910254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.910261 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.911768 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.912090 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.912091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.912092 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.912141 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.912315 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.912316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.912316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.912416 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.912492 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.913127 (+ 635us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.913188 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2779,"thread_start_us":47,"threads_started":1}
I20260810 14:49:01.914568 31545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.900793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49540 (local address 127.19.29.253:38637)
0810 14:49:01.901021 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.901022 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.902274 (+ 1252us) server_negotiation.cc:407] Connection header received
0810 14:49:01.902317 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.902318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.902332 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.902385 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:01.903094 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.903833 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.904887 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.905179 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.905252 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.906654 (+ 1402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:01.906656 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:01.906656 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:01.906663 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:01.913380 (+ 6717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.913906 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.913907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.913908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.913963 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:01.914138 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:01.914139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:01.914139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:01.914234 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:01.914333 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.914445 (+ 112us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.914509 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":55,"threads_started":1}
I20260810 14:49:01.914269 29305 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38648:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:01.915928 29305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:01.916652 30617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.916759 30617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.917656 30617 raft_consensus.cc:1013] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: attempt to promote peer 1fe4fb84e9b94864b31b4a29f9b833a3: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260810 14:49:01.944412 31539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.941974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40560 (local address 127.19.29.252:33561)
0810 14:49:01.942065 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.942067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.942075 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:01.942102 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.942103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.942125 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.942194 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:01.942333 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.942816 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.943726 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.944119 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.944174 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.944229 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.944323 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.944359 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:49:01.944434 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.941894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.0.0.1:40560)
0810 14:49:01.941954 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.941964 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.942005 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.942203 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.942204 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.942205 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:01.942257 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.942258 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.942909 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.942911 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.943650 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.943653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.944182 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.944183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.944223 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.944226 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.944311 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.944354 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 14:49:01.944775 30697 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Deduplicated request from leader. Original: 1.6->[1.7-1.8] Dedup: 1.7->[1.8-1.8]
I20260810 14:49:01.945164 30757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 689243c2b527411d94ff9949b3d2080f. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: NON_VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: true } } } pending_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.945286 30757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:01.945600 30259 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.945768 30697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.946636 30623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.946736 30623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.946841 30352 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.946929 30757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.946995 30757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:01.947068 30617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.947147 30617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.948031 30614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: NON_VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: true } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.948113 30614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEARNER
I20260810 14:49:01.949254 30258 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: attempting to promote NON_VOTER 1fe4fb84e9b94864b31b4a29f9b833a3 to VOTER
I20260810 14:49:01.949380 30258 consensus_queue.cc:237] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:01.949858 30697 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 14:49:01.949864 30352 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 LEARNER]: Refusing update from remote peer 689243c2b527411d94ff9949b3d2080f: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20260810 14:49:01.950098 30259 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 14:49:01.950219 30623 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [LEADER]: Connected to new peer: Peer: permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260810 14:49:01.950896 30623 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951016 30697 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951738 30623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951807 30623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.951850 30623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951887 30623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.951920 30623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951957 30623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:01.951911 30757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.951980 30757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:01.952200 30352 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index 7 to 10, 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.952955 30614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "689243c2b527411d94ff9949b3d2080f" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:01.952997 30256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.948740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:33925 (local address 127.0.0.1:46688)
0810 14:49:01.948915 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.948925 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.948968 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.949700 (+ 732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.949701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.949703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:01.949739 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.949742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.950920 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.950921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.951926 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.951929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.952784 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.952785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.952842 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.952846 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.952898 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.952934 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160}
I20260810 14:49:01.953022 30614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:01.953032 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.948887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46688 (local address 127.19.29.195:33925)
0810 14:49:01.949405 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.949410 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.949420 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:01.949457 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.949459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.949477 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.949580 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:01.949820 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.950831 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.952044 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.952706 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.952770 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.952846 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.952913 (+ 67us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.952948 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":484,"thread_start_us":73,"threads_started":1}
I20260810 14:49:01.953634 31568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.948860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41045 (local address 127.0.0.1:45302)
0810 14:49:01.949677 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.949687 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.949738 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.950017 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.950018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.950020 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:01.950094 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.950096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.951252 (+ 1156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.951253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.952452 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.952455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.953415 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.953416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.953482 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.953486 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.953530 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.953568 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":799,"thread_start_us":86,"threads_started":1}
I20260810 14:49:01.953675 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.949156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45302 (local address 127.19.29.193:41045)
0810 14:49:01.949354 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.949359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.949803 (+ 444us) server_negotiation.cc:407] Connection header received
0810 14:49:01.949850 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.949853 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.949868 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.949925 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:01.950169 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.951165 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.952541 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.953252 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.953314 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.953380 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.953567 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.953606 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":88,"threads_started":1}
I20260810 14:49:01.953675 31403 tablet_service.cc:1467] Processing CreateTablet for tablet 70d96a8cb58345738e949d6ac854312a (DEFAULT_TABLE table=test-table [id=5b80b43715c94231be863f0e2911b935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:01.954093 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d96a8cb58345738e949d6ac854312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:01.954983 30907 tablet_service.cc:1467] Processing CreateTablet for tablet 70d96a8cb58345738e949d6ac854312a (DEFAULT_TABLE table=test-table [id=5b80b43715c94231be863f0e2911b935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:01.955302 30907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d96a8cb58345738e949d6ac854312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:01.957252 31576 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Bootstrap starting.
I20260810 14:49:01.957784 31577 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Bootstrap starting.
I20260810 14:49:01.957814 31576 tablet_bootstrap.cc:654] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:01.958097 31576 log.cc:824] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:01.958433 31577 tablet_bootstrap.cc:654] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:01.958828 31577 log.cc:824] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:01.958854 31576 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: No bootstrap required, opened a new log
I20260810 14:49:01.958918 31576 ts_tablet_manager.cc:1397] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:49:01.959576 31577 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: No bootstrap required, opened a new log
I20260810 14:49:01.959647 31577 ts_tablet_manager.cc:1397] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:49:01.960443 31576 raft_consensus.cc:348] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.960598 31563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.948787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45035 (local address 127.0.0.1:54510)
0810 14:49:01.948922 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:01.948931 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:01.948968 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:01.953926 (+ 4958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:01.953927 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:01.953929 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:01.953966 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.953968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.958528 (+ 4560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.958529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.959465 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:01.959468 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.960355 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.960356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:01.960418 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.960423 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:49:01.960484 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:49:01.960524 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":90,"threads_started":1}
I20260810 14:49:01.960638 31576 raft_consensus.cc:374] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:01.960768 31576 raft_consensus.cc:729] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c9a7289d294cf9adcd49949d57d61c, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.960894 31574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:01.949160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54510 (local address 127.19.29.194:45035)
0810 14:49:01.953776 (+ 4616us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:01.953780 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:01.953791 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:49:01.953828 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:01.953830 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:01.953845 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:01.953923 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:01.954031 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.958331 (+ 4300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.959568 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:01.960267 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:01.960339 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:01.960414 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:01.960767 (+ 353us) server_negotiation.cc:299] Negotiation successful
0810 14:49:01.960812 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4578,"thread_start_us":103,"threads_started":1}
I20260810 14:49:01.960896 31576 consensus_queue.cc:260] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.961148 31576 ts_tablet_manager.cc:1428] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:01.961309 31517 heartbeater.cc:503] Master 127.19.29.254:43431 was elected leader, sending a full tablet report...
I20260810 14:49:01.961556 31160 tablet_service.cc:1467] Processing CreateTablet for tablet 70d96a8cb58345738e949d6ac854312a (DEFAULT_TABLE table=test-table [id=5b80b43715c94231be863f0e2911b935]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:01.961578 31577 raft_consensus.cc:348] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.961721 31577 raft_consensus.cc:374] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:01.961751 31577 raft_consensus.cc:729] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ea52befe31461bba4057815b520204, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.961894 31160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70d96a8cb58345738e949d6ac854312a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:01.961869 31577 consensus_queue.cc:260] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.962113 31577 ts_tablet_manager.cc:1428] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:49:01.962421 31031 heartbeater.cc:503] Master 127.19.29.254:43431 was elected leader, sending a full tablet report...
I20260810 14:49:01.964972 31589 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Bootstrap starting.
I20260810 14:49:01.965694 31589 tablet_bootstrap.cc:654] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:01.965927 31589 log.cc:824] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:01.966554 31589 tablet_bootstrap.cc:492] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: No bootstrap required, opened a new log
I20260810 14:49:01.966606 31589 ts_tablet_manager.cc:1397] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:49:01.968272 31589 raft_consensus.cc:348] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.968389 31589 raft_consensus.cc:374] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:01.968408 31589 raft_consensus.cc:729] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b22907583d3f4e20bf51b8e6a4ce7e58, State: Initialized, Role: FOLLOWER
I20260810 14:49:01.968492 31589 consensus_queue.cc:260] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:01.968699 31589 ts_tablet_manager.cc:1428] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:01.968739 31270 heartbeater.cc:503] Master 127.19.29.254:43431 was elected leader, sending a full tablet report...
W20260810 14:49:02.004918 31279 tablet.cc:2369] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:49:02.090775 31035 tablet.cc:2369] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:49:02.146872 31523 tablet.cc:2369] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:49:02.355980 31583 raft_consensus.cc:482] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:02.356114 31583 raft_consensus.cc:504] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:02.356510 31583 leader_election.cc:288] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6ea52befe31461bba4057815b520204 (127.19.29.193:41045), b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
I20260810 14:49:02.360293 31573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.356761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:54863 (local address 127.19.29.193:41045)
0810 14:49:02.356806 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.356808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.356857 (+ 49us) server_negotiation.cc:407] Connection header received
0810 14:49:02.356888 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.356889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.356898 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.356953 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:02.357135 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.357880 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.359380 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.359930 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.360018 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.360025 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.360183 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.360221 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:49:02.360293 31574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.356763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:48695 (local address 127.19.29.194:45035)
0810 14:49:02.356806 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.356808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.356857 (+ 49us) server_negotiation.cc:407] Connection header received
0810 14:49:02.356888 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.356889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.356898 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.356953 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:02.357150 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.357900 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.359378 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.359946 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.360012 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.360023 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.360183 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.360222 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:49:02.360309 31527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.356694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41045 (local address 127.19.29.195:54863)
0810 14:49:02.356758 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:02.356765 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:02.356803 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:02.356966 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:02.356967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:02.356969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:02.357069 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:02.357071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.357968 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.357969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:02.359263 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:02.359267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.360019 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.360020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:02.360110 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.360115 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:49:02.360172 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 14:49:02.360220 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":76,"spinlock_wait_cycles":896}
I20260810 14:49:02.360309 31528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.356682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45035 (local address 127.19.29.195:48695)
0810 14:49:02.356743 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:02.356755 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:02.356803 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:02.356966 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:02.356967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:02.356969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:02.357069 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:02.357084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.357968 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.357969 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:02.359263 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:02.359267 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.360019 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.360020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:02.360110 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.360115 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:49:02.360172 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 14:49:02.360220 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":40}
I20260810 14:49:02.360716 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d96a8cb58345738e949d6ac854312a" candidate_uuid: "54c9a7289d294cf9adcd49949d57d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ea52befe31461bba4057815b520204" is_pre_election: true
I20260810 14:49:02.360771 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d96a8cb58345738e949d6ac854312a" candidate_uuid: "54c9a7289d294cf9adcd49949d57d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" is_pre_election: true
I20260810 14:49:02.360852 30940 raft_consensus.cc:2454] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c9a7289d294cf9adcd49949d57d61c in term 0.
I20260810 14:49:02.360909 31193 raft_consensus.cc:2454] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c9a7289d294cf9adcd49949d57d61c in term 0.
I20260810 14:49:02.361080 31310 leader_election.cc:302] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54c9a7289d294cf9adcd49949d57d61c, c6ea52befe31461bba4057815b520204; no voters:
I20260810 14:49:02.361207 31583 raft_consensus.cc:2781] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:02.361258 31583 raft_consensus.cc:482] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:02.361282 31583 raft_consensus.cc:3037] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:02.361970 31583 raft_consensus.cc:504] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:02.362099 31583 leader_election.cc:288] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [CANDIDATE]: Term 1 election: Requested vote from peers c6ea52befe31461bba4057815b520204 (127.19.29.193:41045), b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194:45035)
I20260810 14:49:02.362262 31193 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d96a8cb58345738e949d6ac854312a" candidate_uuid: "54c9a7289d294cf9adcd49949d57d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58"
I20260810 14:49:02.362258 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70d96a8cb58345738e949d6ac854312a" candidate_uuid: "54c9a7289d294cf9adcd49949d57d61c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ea52befe31461bba4057815b520204"
I20260810 14:49:02.362360 31193 raft_consensus.cc:3037] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:02.362360 30940 raft_consensus.cc:3037] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:02.363197 30940 raft_consensus.cc:2454] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54c9a7289d294cf9adcd49949d57d61c in term 1.
I20260810 14:49:02.363197 31193 raft_consensus.cc:2454] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54c9a7289d294cf9adcd49949d57d61c in term 1.
I20260810 14:49:02.363375 31314 leader_election.cc:302] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54c9a7289d294cf9adcd49949d57d61c, b22907583d3f4e20bf51b8e6a4ce7e58; no voters:
I20260810 14:49:02.363523 31583 raft_consensus.cc:2781] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:02.363672 31583 raft_consensus.cc:686] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 1 LEADER]: Becoming Leader. State: Replica: 54c9a7289d294cf9adcd49949d57d61c, State: Running, Role: LEADER
I20260810 14:49:02.363770 31583 consensus_queue.cc:237] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } }
I20260810 14:49:02.364549 29305 catalog_manager.cc:5495] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c reported cstate change: term changed from 0 to 1, leader changed from <none> to 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195). New cstate: current_term: 1 leader_uuid: "54c9a7289d294cf9adcd49949d57d61c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } health_report { overall_health: UNKNOWN } } }
I20260810 14:49:02.390653 31572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.388473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46690 (local address 127.19.29.195:33925)
0810 14:49:02.388547 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.388548 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.388555 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:02.388591 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.388591 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.388608 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.388667 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:02.388782 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.389241 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.389953 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.390155 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.390216 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.390348 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:02.390451 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:02.390525 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.390537 (+ 12us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.390558 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260810 14:49:02.392403 30940 raft_consensus.cc:1261] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Refusing update from remote peer 54c9a7289d294cf9adcd49949d57d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:02.392405 31193 raft_consensus.cc:1261] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Refusing update from remote peer 54c9a7289d294cf9adcd49949d57d61c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:02.392737 31583 consensus_queue.cc:1035] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:02.392885 31592 consensus_queue.cc:1035] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:02.395715 31597 mvcc.cc:205] Tried to move back new op lower bound from 7316985210436784128 to 7316985210322501632. Current Snapshot: MvccSnapshot[applied={T|T < 7316985210436784128}]
I20260810 14:49:02.398170 29305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:02.398253 29305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38648:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:02.399508 29305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 689243c2b527411d94ff9949b3d2080f: Sending DeleteTablet for 3 replicas of tablet 70d96a8cb58345738e949d6ac854312a
I20260810 14:49:02.399874 31160 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d96a8cb58345738e949d6ac854312a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:02 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:54510
I20260810 14:49:02.400082 31614 tablet_replica.cc:330] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: stopping tablet replica
I20260810 14:49:02.400189 31614 raft_consensus.cc:2229] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:02.400295 31614 raft_consensus.cc:2258] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:02.400272 30907 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d96a8cb58345738e949d6ac854312a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:02 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:45302
I20260810 14:49:02.400465 31616 tablet_replica.cc:330] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: stopping tablet replica
I20260810 14:49:02.400558 31616 raft_consensus.cc:2229] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:02.400702 31616 raft_consensus.cc:2258] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:02.400971 31614 ts_tablet_manager.cc:1905] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:02.401278 31616 ts_tablet_manager.cc:1905] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:02.401484 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet 70d96a8cb58345738e949d6ac854312a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:02 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:46688
I20260810 14:49:02.402083 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 29254
I20260810 14:49:02.403102 31614 ts_tablet_manager.cc:1918] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:02.403218 31614 log.cc:1196] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/70d96a8cb58345738e949d6ac854312a
I20260810 14:49:02.403512 31614 ts_tablet_manager.cc:1939] T 70d96a8cb58345738e949d6ac854312a P b22907583d3f4e20bf51b8e6a4ce7e58: Deleting consensus metadata
I20260810 14:49:02.411301 31620 tablet_replica.cc:330] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: stopping tablet replica
I20260810 14:49:02.411424 31620 raft_consensus.cc:2229] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:02.411532 31620 raft_consensus.cc:2258] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:02.413436 31620 ts_tablet_manager.cc:1905] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:02.415192 31620 ts_tablet_manager.cc:1918] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:02.415329 31620 log.cc:1196] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/70d96a8cb58345738e949d6ac854312a
I20260810 14:49:02.415673 31620 ts_tablet_manager.cc:1939] T 70d96a8cb58345738e949d6ac854312a P 54c9a7289d294cf9adcd49949d57d61c: Deleting consensus metadata
I20260810 14:49:02.418236 31539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.400881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.19.29.252:33561)
0810 14:49:02.400918 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.400920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.411744 (+ 10824us) server_negotiation.cc:407] Connection header received
0810 14:49:02.411807 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.411808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.411818 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.411856 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:02.412409 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.413004 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.413932 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.414218 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.414263 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.415870 (+ 1607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:02.415871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:02.415872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:02.415880 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:02.417251 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.417551 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.417552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.417553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.417604 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.417771 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.417772 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.417772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.417877 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:02.417962 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.418072 (+ 110us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.418146 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:49:02.420202 31075 connection.cc:535] server connection from 127.0.0.1:54510 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 14:49:02.420284 31312 connection.cc:535] server connection from 127.0.0.1:46688 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:49:02.421164 31616 ts_tablet_manager.cc:1918] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:02.421253 31616 log.cc:1196] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/70d96a8cb58345738e949d6ac854312a
I20260810 14:49:02.421561 31616 ts_tablet_manager.cc:1939] T 70d96a8cb58345738e949d6ac854312a P c6ea52befe31461bba4057815b520204: Deleting consensus metadata
W20260810 14:49:02.421975 30812 connection.cc:441] server connection from 127.0.0.1:45302 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45302 (request call id 1) could send its response
I20260810 14:49:02.428020 31539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.422057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40570 (local address 127.19.29.252:33561)
0810 14:49:02.422141 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.422143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.422193 (+ 50us) server_negotiation.cc:407] Connection header received
0810 14:49:02.422252 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.422252 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.422262 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.422352 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:02.423025 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.423653 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.424304 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.424496 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.424548 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.425756 (+ 1208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:02.425757 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:02.425757 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:02.425764 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:02.427018 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.427313 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.427314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.427314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.427364 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.427521 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.427522 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.427523 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.427642 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:02.427743 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.427861 (+ 118us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.427933 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260810 14:49:02.430684 31634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:02.422175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49548 (local address 127.19.29.253:38637)
0810 14:49:02.422433 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:02.422435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:02.422627 (+ 192us) server_negotiation.cc:407] Connection header received
0810 14:49:02.422651 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:02.422651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:02.422661 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:02.422744 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:02.423436 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.424229 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.425408 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:02.425737 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:02.425801 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:02.428129 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:02.428130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:02.428131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:02.428137 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:02.429590 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.429874 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.429875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.429875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.429934 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:02.430098 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:02.430098 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:02.430099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:02.430226 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:02.430342 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:02.430495 (+ 153us) server_negotiation.cc:299] Negotiation successful
0810 14:49:02.430586 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239,"thread_start_us":51,"threads_started":1}
I20260810 14:49:03.397455 31637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.397154 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:54211)
0810 14:49:03.397312 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.397398 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":70,"threads_started":1}
I20260810 14:49:03.397454 31638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.397156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:44831)
0810 14:49:03.397311 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.397398 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":74,"threads_started":1}
W20260810 14:49:03.397822 31270 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:43431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
W20260810 14:49:03.398083 31517 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:43431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
I20260810 14:49:03.398180 31641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.397860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:39911)
0810 14:49:03.398068 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.398134 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":47,"threads_started":1}
W20260810 14:49:03.398396 31031 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:43431 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
I20260810 14:49:03.900316 31642 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 689243c2b527411d94ff9949b3d2080f)
I20260810 14:49:03.900480 31642 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:03.900710 31645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 689243c2b527411d94ff9949b3d2080f)
I20260810 14:49:03.900774 31642 leader_election.cc:288] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431), 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252:33561)
I20260810 14:49:03.900921 31645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:03.901499 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.901281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39094)
0810 14:49:03.901397 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.901456 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":46,"threads_started":1}
I20260810 14:49:03.901497 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.901284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39086)
0810 14:49:03.901386 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.901457 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":60,"threads_started":1}
W20260810 14:49:03.901662 30303 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
W20260810 14:49:03.901749 30660 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
I20260810 14:49:03.901662 31645 leader_election.cc:288] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431), 1fe4fb84e9b94864b31b4a29f9b833a3 (127.19.29.253:38637)
I20260810 14:49:03.902165 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.902084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39098)
0810 14:49:03.902118 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.902139 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260810 14:49:03.902282 31652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.902197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39112)
0810 14:49:03.902233 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.902255 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260810 14:49:03.902323 30303 leader_election.cc:334] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431): Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
W20260810 14:49:03.902530 30660 leader_election.cc:334] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431): Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
I20260810 14:49:03.904399 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.900947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:33561 (local address 127.0.0.1:40576)
0810 14:49:03.901174 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.901186 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:03.901254 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:03.901432 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:03.901434 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:03.901436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:03.901496 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.901499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.902516 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.902522 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.903641 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.903645 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.904225 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.904226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.904271 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.904275 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:03.904311 (+ 36us) client_negotiation.cc:240] Negotiation successful
0810 14:49:03.904344 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":50,"threads_started":1}
I20260810 14:49:03.904417 31647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.901069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.19.29.252:33561)
0810 14:49:03.901172 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:03.901174 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:03.901234 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:49:03.901306 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:03.901307 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:03.901317 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:03.901374 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:03.901578 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.902342 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.903726 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.904147 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.904219 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.904231 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:03.904319 (+ 88us) server_negotiation.cc:299] Negotiation successful
0810 14:49:03.904355 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"thread_start_us":45,"threads_started":1}
I20260810 14:49:03.904641 30697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3469dac0d8204045bfb92aa9cb5899fc" is_pre_election: true
I20260810 14:49:03.904767 30697 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1fe4fb84e9b94864b31b4a29f9b833a3 in term 1.
I20260810 14:49:03.904893 31650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.901464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:38637 (local address 127.0.0.1:49560)
0810 14:49:03.901706 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.901715 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:03.901769 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:03.901985 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:03.901986 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:03.901989 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:03.902038 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.902040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.902928 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.902929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.903986 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.903989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.904668 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.904669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.904736 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.904740 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:03.904794 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 14:49:03.904834 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":53,"threads_started":1}
I20260810 14:49:03.904912 31653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.901597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49560 (local address 127.19.29.253:38637)
0810 14:49:03.901849 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:03.901851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:03.901858 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:03.901880 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:03.901881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:03.901890 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:03.902104 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:03.902150 (+ 46us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.902843 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.904057 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.904599 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.904667 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.904678 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:03.904808 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:49:03.904847 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":47,"threads_started":1}
I20260810 14:49:03.904930 30298 leader_election.cc:302] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1fe4fb84e9b94864b31b4a29f9b833a3, 3469dac0d8204045bfb92aa9cb5899fc; no voters: 689243c2b527411d94ff9949b3d2080f
I20260810 14:49:03.905040 31642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260810 14:49:03.905073 31642 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 689243c2b527411d94ff9949b3d2080f)
I20260810 14:49:03.905092 31642 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:49:03.905252 30352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3469dac0d8204045bfb92aa9cb5899fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" is_pre_election: true
I20260810 14:49:03.905793 31642 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:03.905905 30352 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3469dac0d8204045bfb92aa9cb5899fc in current term 2: Already voted for candidate 1fe4fb84e9b94864b31b4a29f9b833a3 in this term.
I20260810 14:49:03.905915 31642 leader_election.cc:288] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 election: Requested vote from peers 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431), 3469dac0d8204045bfb92aa9cb5899fc (127.19.29.252:33561)
I20260810 14:49:03.906103 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.906019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39126)
0810 14:49:03.906058 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.906083 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 14:49:03.906103 30697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3469dac0d8204045bfb92aa9cb5899fc"
I20260810 14:49:03.906132 30660 leader_election.cc:302] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3469dac0d8204045bfb92aa9cb5899fc; no voters: 1fe4fb84e9b94864b31b4a29f9b833a3, 689243c2b527411d94ff9949b3d2080f
I20260810 14:49:03.906160 30697 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:49:03.906875 30697 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1fe4fb84e9b94864b31b4a29f9b833a3 in term 2.
I20260810 14:49:03.906947 31645 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:49:03.907157 30298 leader_election.cc:302] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fe4fb84e9b94864b31b4a29f9b833a3, 3469dac0d8204045bfb92aa9cb5899fc; no voters:
I20260810 14:49:03.907236 31642 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:49:03.907294 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.907195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39134)
0810 14:49:03.907242 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.907271 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260810 14:49:03.907352 30303 leader_election.cc:334] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431): Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
I20260810 14:49:03.907373 31642 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [term 2 LEADER]: Becoming Leader. State: Replica: 1fe4fb84e9b94864b31b4a29f9b833a3, State: Running, Role: LEADER
I20260810 14:49:03.907454 31642 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } }
I20260810 14:49:03.907758 31664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fe4fb84e9b94864b31b4a29f9b833a3. Latest consensus state: current_term: 2 leader_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:03.907829 31664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:03.907958 31666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:03.908485 31666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:03.908576 31666 catalog_manager.cc:1259] Loaded cluster ID: 30f1e1dd4fb8499899786635bc8744b5
I20260810 14:49:03.908608 31666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:49:03.908761 31666 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:03.908834 31666 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Loaded TSK: 0
I20260810 14:49:03.908964 31666 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:49:03.969748 30329 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:03.971371 30329 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:03.972306 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.972189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39160)
0810 14:49:03.972233 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.972271 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 14:49:03.972334 30697 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [term 2 FOLLOWER]: Refusing update from remote peer 1fe4fb84e9b94864b31b4a29f9b833a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260810 14:49:03.972644 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.972532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.0.0.1:39170)
0810 14:49:03.972583 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.972615 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:49:03.972666 31664 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260810 14:49:03.972793 30303 consensus_peers.cc:487] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 -> Peer 689243c2b527411d94ff9949b3d2080f (127.19.29.254:43431): Couldn't send request to peer 689243c2b527411d94ff9949b3d2080f. Status: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260810 14:49:03.973343 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fe4fb84e9b94864b31b4a29f9b833a3. Latest consensus state: current_term: 2 leader_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:03.973436 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:03.973732 31668 mvcc.cc:205] Tried to move back new op lower bound from 7316985216908804096 to 7316985216645505024. Current Snapshot: MvccSnapshot[applied={T|T < 7316985216908804096}]
I20260810 14:49:03.973815 31642 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:03.973907 31642 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:03.973964 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" committed_config { opid_index: 10 OBSOLETE_local: true peers { permanent_uuid: "689243c2b527411d94ff9949b3d2080f" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43431 } } peers { permanent_uuid: "1fe4fb84e9b94864b31b4a29f9b833a3" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 38637 } attrs { promote: false } } peers { permanent_uuid: "3469dac0d8204045bfb92aa9cb5899fc" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 33561 } attrs { promote: false } } }
I20260810 14:49:03.974129 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3469dac0d8204045bfb92aa9cb5899fc [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:49:03.979154 31651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41045 (local address 127.0.0.1:45310)
0810 14:49:03.975966 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.975976 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:03.976025 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:03.976541 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:03.976542 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:03.976545 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:03.976592 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.976593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.977385 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.977385 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.978358 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.978361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.978928 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.978928 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.978998 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.979001 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:03.979048 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:49:03.979091 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":4}
I20260810 14:49:03.979171 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45310 (local address 127.19.29.193:41045)
0810 14:49:03.976436 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:03.976439 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:03.976446 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:03.976469 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:03.976470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:03.976480 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:03.976541 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:03.976636 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.977322 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.978451 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.978860 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.978921 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.978934 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:03.979060 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 14:49:03.979107 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":58,"threads_started":1}
I20260810 14:49:03.979389 31646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:33925 (local address 127.0.0.1:46704)
0810 14:49:03.975952 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.975963 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:03.976004 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:03.976214 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:03.976215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:03.976217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:03.976262 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.976264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.977157 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.977158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.978466 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.978468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.979197 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.979198 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.979254 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.979260 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:49:03.979287 (+ 27us) client_negotiation.cc:240] Negotiation successful
0810 14:49:03.979325 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":2}
I20260810 14:49:03.979481 30907 tablet_service.cc:1467] Processing CreateTablet for tablet 281e42f9496d4be29be88f9c91d942ba (DEFAULT_TABLE table=test-table [id=723b10fdbee740e982bfe31823201fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:03.979614 30907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281e42f9496d4be29be88f9c91d942ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:03.979699 31683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46704 (local address 127.19.29.195:33925)
0810 14:49:03.976046 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:03.976048 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:03.976074 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:49:03.976102 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:03.976103 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:03.976115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:03.976179 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:03.976319 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.977087 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.978539 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.979107 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.979566 (+ 459us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.979579 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:03.979598 (+ 19us) server_negotiation.cc:299] Negotiation successful
0810 14:49:03.979632 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":60,"threads_started":1}
I20260810 14:49:03.979894 31403 tablet_service.cc:1467] Processing CreateTablet for tablet 281e42f9496d4be29be88f9c91d942ba (DEFAULT_TABLE table=test-table [id=723b10fdbee740e982bfe31823201fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:03.980000 31403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281e42f9496d4be29be88f9c91d942ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:03.980095 31681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45035 (local address 127.0.0.1:54520)
0810 14:49:03.976097 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.976105 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:03.976141 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:03.977187 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:03.977188 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:03.977191 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:03.977229 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.977231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.978107 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.978108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.979189 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:03.979192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.979874 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.979875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:03.979946 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.979951 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:49:03.979994 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:49:03.980032 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":68,"threads_started":1}
I20260810 14:49:03.980114 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.975900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54520 (local address 127.19.29.194:45035)
0810 14:49:03.976263 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:03.976265 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:03.976272 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:03.976296 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:03.976296 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:03.976307 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:03.976360 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:03.977300 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.978024 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.979272 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:03.979799 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:03.979864 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:03.979876 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:03.980010 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 14:49:03.980052 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":341,"thread_start_us":70,"threads_started":1}
I20260810 14:49:03.980301 31160 tablet_service.cc:1467] Processing CreateTablet for tablet 281e42f9496d4be29be88f9c91d942ba (DEFAULT_TABLE table=test-table [id=723b10fdbee740e982bfe31823201fc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:03.980402 31160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 281e42f9496d4be29be88f9c91d942ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:03.981046 31686 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: Bootstrap starting.
I20260810 14:49:03.981594 31688 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Bootstrap starting.
I20260810 14:49:03.981760 31686 tablet_bootstrap.cc:654] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:03.981957 31688 tablet_bootstrap.cc:654] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:03.982204 31694 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: Bootstrap starting.
I20260810 14:49:03.982357 31686 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: No bootstrap required, opened a new log
I20260810 14:49:03.982410 31686 ts_tablet_manager.cc:1397] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:03.982501 31688 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: No bootstrap required, opened a new log
I20260810 14:49:03.982556 31688 ts_tablet_manager.cc:1397] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:03.982591 31694 tablet_bootstrap.cc:654] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:03.982606 31686 raft_consensus.cc:348] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.982679 31686 raft_consensus.cc:374] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:03.982698 31686 raft_consensus.cc:729] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6ea52befe31461bba4057815b520204, State: Initialized, Role: FOLLOWER
I20260810 14:49:03.982686 31688 raft_consensus.cc:348] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.982772 31688 raft_consensus.cc:374] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:03.982776 31686 consensus_queue.cc:260] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.982805 31688 raft_consensus.cc:729] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c9a7289d294cf9adcd49949d57d61c, State: Initialized, Role: FOLLOWER
I20260810 14:49:03.982847 31688 consensus_queue.cc:260] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.982940 31686 ts_tablet_manager.cc:1428] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:03.983006 31688 ts_tablet_manager.cc:1428] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:03.983516 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.983075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:33203)
0810 14:49:03.983430 (+ 355us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.983467 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":335,"thread_start_us":81,"threads_started":1}
I20260810 14:49:03.983696 31034 heartbeater.cc:503] Master 127.19.29.253:38637 was elected leader, sending a full tablet report...
I20260810 14:49:03.983839 31694 tablet_bootstrap.cc:492] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: No bootstrap required, opened a new log
I20260810 14:49:03.983862 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.983199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:54595)
0810 14:49:03.983792 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.983830 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":66,"threads_started":1}
I20260810 14:49:03.983889 31694 ts_tablet_manager.cc:1397] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:49:03.984036 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.983868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:53321)
0810 14:49:03.983986 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.984014 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260810 14:49:03.984064 31694 raft_consensus.cc:348] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.984135 31694 raft_consensus.cc:374] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:03.984159 31694 raft_consensus.cc:729] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b22907583d3f4e20bf51b8e6a4ce7e58, State: Initialized, Role: FOLLOWER
I20260810 14:49:03.984201 31694 consensus_queue.cc:260] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:03.984380 31694 ts_tablet_manager.cc:1428] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:03.984391 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.984293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:52021)
0810 14:49:03.984341 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.984370 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260810 14:49:03.984521 31520 heartbeater.cc:503] Master 127.19.29.253:38637 was elected leader, sending a full tablet report...
I20260810 14:49:03.984925 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.984693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:47379)
0810 14:49:03.984857 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.984893 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":81,"threads_started":1}
I20260810 14:49:03.985270 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:03.985177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:60443)
0810 14:49:03.985223 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:03.985247 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260810 14:49:03.985421 31278 heartbeater.cc:503] Master 127.19.29.253:38637 was elected leader, sending a full tablet report...
I20260810 14:49:04.148319 31707 raft_consensus.cc:482] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:04.148429 31707 raft_consensus.cc:504] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:04.148792 31707 leader_election.cc:288] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925), c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
I20260810 14:49:04.151767 31683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.149119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:56133 (local address 127.19.29.195:33925)
0810 14:49:04.149168 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:04.149170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:04.149179 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:04.149210 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:04.149211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:04.149220 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:04.149279 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:04.149472 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.149984 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151062 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.151422 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151477 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:04.151486 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:04.151649 (+ 163us) server_negotiation.cc:299] Negotiation successful
0810 14:49:04.151693 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:49:04.151784 31685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.149126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:35343 (local address 127.19.29.193:41045)
0810 14:49:04.149178 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:04.149181 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:04.149293 (+ 112us) server_negotiation.cc:407] Connection header received
0810 14:49:04.149332 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:04.149333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:04.149343 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:04.149407 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:04.149599 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.150116 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151096 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.151450 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151519 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:04.151528 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:04.151678 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 14:49:04.151718 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:49:04.151783 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.148953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:33925 (local address 127.19.29.194:56133)
0810 14:49:04.149004 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.149016 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:04.149078 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:04.149308 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:04.149310 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:04.149313 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:04.149399 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:04.149402 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.150089 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.150090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:04.150968 (+ 878us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:04.150971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.151501 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151503 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:04.151584 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:04.151587 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:04.151627 (+ 40us) client_negotiation.cc:240] Negotiation successful
0810 14:49:04.151668 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:49:04.151794 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.148985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41045 (local address 127.19.29.194:35343)
0810 14:49:04.149230 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.149239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:04.149288 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:04.149413 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:04.149414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:04.149416 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:04.149479 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:04.149481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.150199 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.150199 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:04.150994 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:04.150996 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.151553 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.151554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:04.151604 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:04.151608 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:04.151659 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 14:49:04.151695 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":221,"thread_start_us":118,"threads_started":1}
I20260810 14:49:04.152076 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281e42f9496d4be29be88f9c91d942ba" candidate_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ea52befe31461bba4057815b520204" is_pre_election: true
I20260810 14:49:04.152089 31434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281e42f9496d4be29be88f9c91d942ba" candidate_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54c9a7289d294cf9adcd49949d57d61c" is_pre_election: true
I20260810 14:49:04.152172 30940 raft_consensus.cc:2454] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22907583d3f4e20bf51b8e6a4ce7e58 in term 0.
I20260810 14:49:04.152217 31434 raft_consensus.cc:2454] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b22907583d3f4e20bf51b8e6a4ce7e58 in term 0.
I20260810 14:49:04.152361 31073 leader_election.cc:302] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b22907583d3f4e20bf51b8e6a4ce7e58, c6ea52befe31461bba4057815b520204; no voters:
I20260810 14:49:04.152554 31707 raft_consensus.cc:2781] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:04.152608 31707 raft_consensus.cc:482] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:04.152626 31707 raft_consensus.cc:3037] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:04.153311 31707 raft_consensus.cc:504] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:04.153439 31707 leader_election.cc:288] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [CANDIDATE]: Term 1 election: Requested vote from peers 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925), c6ea52befe31461bba4057815b520204 (127.19.29.193:41045)
I20260810 14:49:04.153621 30940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281e42f9496d4be29be88f9c91d942ba" candidate_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6ea52befe31461bba4057815b520204"
I20260810 14:49:04.153644 31434 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "281e42f9496d4be29be88f9c91d942ba" candidate_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54c9a7289d294cf9adcd49949d57d61c"
I20260810 14:49:04.153690 30940 raft_consensus.cc:3037] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:04.153707 31434 raft_consensus.cc:3037] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:04.154381 30940 raft_consensus.cc:2454] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22907583d3f4e20bf51b8e6a4ce7e58 in term 1.
I20260810 14:49:04.154438 31434 raft_consensus.cc:2454] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b22907583d3f4e20bf51b8e6a4ce7e58 in term 1.
I20260810 14:49:04.154560 31073 leader_election.cc:302] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b22907583d3f4e20bf51b8e6a4ce7e58, c6ea52befe31461bba4057815b520204; no voters:
I20260810 14:49:04.154651 31707 raft_consensus.cc:2781] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:04.154804 31707 raft_consensus.cc:686] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 LEADER]: Becoming Leader. State: Replica: b22907583d3f4e20bf51b8e6a4ce7e58, State: Running, Role: LEADER
I20260810 14:49:04.154870 31707 consensus_queue.cc:237] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } }
I20260810 14:49:04.155113 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.155013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:57409)
0810 14:49:04.155056 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.155083 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 14:49:04.155754 30329 catalog_manager.cc:5495] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 reported cstate change: term changed from 0 to 1, leader changed from <none> to b22907583d3f4e20bf51b8e6a4ce7e58 (127.19.29.194). New cstate: current_term: 1 leader_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b22907583d3f4e20bf51b8e6a4ce7e58" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45035 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 } health_report { overall_health: UNKNOWN } } }
I20260810 14:49:04.204699 31684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.202356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54532 (local address 127.19.29.194:45035)
0810 14:49:04.202409 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:04.202411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:04.202419 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:04.202461 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:04.202462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:04.202481 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:04.202545 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:04.202691 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.203188 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.203923 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:04.204159 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:04.204217 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:04.204370 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:04.204475 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:04.204537 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:04.204598 (+ 61us) server_negotiation.cc:299] Negotiation successful
0810 14:49:04.204619 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:49:04.205868 30940 raft_consensus.cc:1261] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Refusing update from remote peer b22907583d3f4e20bf51b8e6a4ce7e58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:04.205924 31434 raft_consensus.cc:1261] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Refusing update from remote peer b22907583d3f4e20bf51b8e6a4ce7e58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:04.206198 31707 consensus_queue.cc:1035] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6ea52befe31461bba4057815b520204" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:04.206346 31712 consensus_queue.cc:1035] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54c9a7289d294cf9adcd49949d57d61c" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 33925 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:04.207113 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.206889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:35865)
0810 14:49:04.207020 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.207080 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260810 14:49:04.207695 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.207510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:50089)
0810 14:49:04.207633 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.207661 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104}
I20260810 14:49:04.208076 31719 mvcc.cc:205] Tried to move back new op lower bound from 7316985217865121792 to 7316985217659125760. Current Snapshot: MvccSnapshot[applied={T|T < 7316985217865121792}]
I20260810 14:49:04.208757 31720 mvcc.cc:205] Tried to move back new op lower bound from 7316985217865121792 to 7316985217659125760. Current Snapshot: MvccSnapshot[applied={T|T < 7316985217865121792}]
I20260810 14:49:04.208909 31706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.208805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.195:59901)
0810 14:49:04.208861 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.208885 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260810 14:49:04.209139 31704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.209019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.193:34511)
0810 14:49:04.209088 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.209111 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:49:04.209187 31711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.208431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43431 (local address 127.19.29.194:59585)
0810 14:49:04.209136 (+ 705us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.209164 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:43431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":690}
I20260810 14:49:04.210691 30329 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:04.210777 30329 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:04.211971 30329 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fe4fb84e9b94864b31b4a29f9b833a3: Sending DeleteTablet for 3 replicas of tablet 281e42f9496d4be29be88f9c91d942ba
I20260810 14:49:04.212340 30907 tablet_service.cc:1514] Processing DeleteTablet for tablet 281e42f9496d4be29be88f9c91d942ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:04 UTC) from {username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:45310
I20260810 14:49:04.212373 31403 tablet_service.cc:1514] Processing DeleteTablet for tablet 281e42f9496d4be29be88f9c91d942ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:04 UTC) from {username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:46704
I20260810 14:49:04.212419 31160 tablet_service.cc:1514] Processing DeleteTablet for tablet 281e42f9496d4be29be88f9c91d942ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:04 UTC) from {username='oryx', principal='oryx/127.19.29.253@KRBTEST.COM'} at 127.0.0.1:54520
I20260810 14:49:04.212553 31741 tablet_replica.cc:330] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204: stopping tablet replica
I20260810 14:49:04.212617 31741 raft_consensus.cc:2229] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:04.212654 31741 raft_consensus.cc:2258] T 281e42f9496d4be29be88f9c91d942ba P c6ea52befe31461bba4057815b520204 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:04.212740 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 30616
I20260810 14:49:04.223708 31737 tablet_replica.cc:330] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: stopping tablet replica
I20260810 14:49:04.223780 31737 raft_consensus.cc:2229] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:04.223829 31737 raft_consensus.cc:2258] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:04.212834 31742 tablet_replica.cc:330] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58: stopping tablet replica
I20260810 14:49:04.224650 31742 raft_consensus.cc:2229] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:04.224702 31737 ts_tablet_manager.cc:1905] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:04.224743 31742 raft_consensus.cc:2258] T 281e42f9496d4be29be88f9c91d942ba P b22907583d3f4e20bf51b8e6a4ce7e58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:04.226279 31737 ts_tablet_manager.cc:1918] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:04.226408 31737 log.cc:1196] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/281e42f9496d4be29be88f9c91d942ba
I20260810 14:49:04.226667 31737 ts_tablet_manager.cc:1939] T 281e42f9496d4be29be88f9c91d942ba P 54c9a7289d294cf9adcd49949d57d61c: Deleting consensus metadata
I20260810 14:49:04.227000 30303 catalog_manager.cc:4841] TS 54c9a7289d294cf9adcd49949d57d61c (127.19.29.195:33925): tablet 281e42f9496d4be29be88f9c91d942ba (table test-table [id=723b10fdbee740e982bfe31823201fc5]) successfully deleted
I20260810 14:49:04.229550 31681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.229440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41045 (local address 127.0.0.1:45326)
0810 14:49:04.229491 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.229520 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:49:04.229686 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 31043
W20260810 14:49:04.229705 30302 catalog_manager.cc:4584] TS c6ea52befe31461bba4057815b520204 (127.19.29.193:41045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 281e42f9496d4be29be88f9c91d942ba: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41045: connect: Connection refused (error 111)
I20260810 14:49:04.242709 31681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:04.242571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45035 (local address 127.0.0.1:54544)
0810 14:49:04.242633 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:04.242666 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.194:45035: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260810 14:49:04.242863 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 31284
I20260810 14:49:04.253695 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 30089
I20260810 14:49:04.265045 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 30427
2026-08-10T14:49:04Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5231 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:49:04 dist-test-slave-4tdj krb5kdc[31748](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:49:04 dist-test-slave-4tdj krb5kdc[31748](info): set up 2 sockets
Aug 10 14:49:04 dist-test-slave-4tdj krb5kdc[31748](info): commencing operation
krb5kdc: starting...
W20260810 14:49:05.450201 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.155s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:05 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:05Z Disabled control of system clock
WARNING: no policy specified for oryx/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab.
Entry for principal oryx/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab.
I20260810 14:49:05.563711 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45329
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab
--principal=oryx/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45329
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:05.643168 31765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:05.643358 31765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:05.643378 31765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:05.644495 31765 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:05.644534 31765 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260810 14:49:05.644546 31765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:05.644557 31765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:05.644570 31765 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:05.644594 31765 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:05.646162 31765 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45329
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.254.keytab
--principal=oryx/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:05.646411 31765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:05.646615 31765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:05.651489 31774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:05.651487 31773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:05.651487 31781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:05.651589 31765 server_base.cc:1034] running on GCE node
I20260810 14:49:05.651925 31765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:05.652215 31765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:05.653344 31765 hybrid_clock.cc:648] HybridClock initialized: now 1786373345653336 us; error 28 us; skew 500 ppm
Aug 10 14:49:05 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:05.655699 31765 init.cc:377] Logged in from keytab as oryx/127.19.29.254@KRBTEST.COM (short username oryx)
I20260810 14:49:05.656090 31765 webserver.cc:460] Webserver started at http://127.19.29.254:44165/ using document root <none> and password file <none>
I20260810 14:49:05.656277 31765 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:05.656323 31765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:05.656441 31765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:05.657428 31765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "101d7e5e98971e50e31d8de6e0bd1358"
server_key_iv: "4a6f4ce83d4dadb283a7b3b73c298bae"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.657780 31765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "101d7e5e98971e50e31d8de6e0bd1358"
server_key_iv: "4a6f4ce83d4dadb283a7b3b73c298bae"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.659052 31765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:05.659731 31793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:05.659883 31765 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:05.659967 31765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "101d7e5e98971e50e31d8de6e0bd1358"
server_key_iv: "4a6f4ce83d4dadb283a7b3b73c298bae"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.660024 31765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:05.672422 31765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:05.674043 31765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:05.674178 31765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:05.678658 31765 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45329
I20260810 14:49:05.678716 31905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45329 every 8 connection(s)
I20260810 14:49:05.679016 31765 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:05.679709 31906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:05.682083 31906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Bootstrap starting.
I20260810 14:49:05.682729 31906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:05.683001 31906 log.cc:824] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:05.683674 31906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: No bootstrap required, opened a new log
I20260810 14:49:05.685712 31906 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } }
I20260810 14:49:05.685850 31906 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:05.685881 31906 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb9d9f795f9941fcb9f4ab4d13a7030e, State: Initialized, Role: FOLLOWER
I20260810 14:49:05.686005 31906 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } }
I20260810 14:49:05.686071 31906 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:05.686102 31906 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:05.686151 31906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:05.686717 31906 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } }
I20260810 14:49:05.686818 31906 leader_election.cc:302] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb9d9f795f9941fcb9f4ab4d13a7030e; no voters:
I20260810 14:49:05.686980 31906 leader_election.cc:288] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:05.687027 31910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:05.687191 31910 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [term 1 LEADER]: Becoming Leader. State: Replica: fb9d9f795f9941fcb9f4ab4d13a7030e, State: Running, Role: LEADER
I20260810 14:49:05.687232 31906 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:05.687302 31910 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } }
I20260810 14:49:05.687706 31911 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } } }
I20260810 14:49:05.687796 31911 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:05.687955 31912 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb9d9f795f9941fcb9f4ab4d13a7030e. Latest consensus state: current_term: 1 leader_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb9d9f795f9941fcb9f4ab4d13a7030e" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45329 } } }
I20260810 14:49:05.688007 31912 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:05.688139 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 31765
I20260810 14:49:05.688238 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:05.688421 19575 external_mini_cluster.cc:1428] Setting key 3a375474b2bd347ac937a7ccca973972
I20260810 14:49:05.688524 31922 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:05.689085 31922 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:05.690761 31922 catalog_manager.cc:1347] Generated new cluster ID: 4e8efafb5b0946a692f8de71f6bfee0e
I20260810 14:49:05.690814 31922 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:49:05 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:05.697415 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:05.688895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34336 (local address 127.19.29.254:45329)
0810 14:49:05.689063 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:05.689073 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:05.689106 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:49:05.689222 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:05.689228 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:05.689274 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:05.689386 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:05.689980 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.691212 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.691901 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.692328 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.692420 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:05.694600 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:05.694604 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:05.694605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:05.694616 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:05.696077 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.696377 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.696380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.696380 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.696462 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.696635 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.696636 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.696637 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.696851 (+ 214us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:05.696988 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:05.697096 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:49:05.697227 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260810 14:49:05.724182 31922 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:05.724736 31922 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:05.735599 31922 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Generated new TSK 0
I20260810 14:49:05.735775 31922 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
I20260810 14:49:05.771199 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45329
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:05.874749 31945 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:05.874934 31945 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:05.874964 31945 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:05.876058 31945 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:05.876111 31945 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:05.876139 31945 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:49:05.876163 31945 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:05.877646 31945 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31945
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:05.877854 31945 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:05.878052 31945 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:05.882910 31951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:05.883033 31957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:05.883054 31945 server_base.cc:1034] running on GCE node
W20260810 14:49:05.882910 31952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:05.883440 31945 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:05.883693 31945 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:05.884833 31945 hybrid_clock.cc:648] HybridClock initialized: now 1786373345884822 us; error 28 us; skew 500 ppm
Aug 10 14:49:05 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:05.887225 31945 init.cc:377] Logged in from keytab as oryx/127.19.29.193@KRBTEST.COM (short username oryx)
I20260810 14:49:05.887676 31945 webserver.cc:460] Webserver started at http://127.19.29.193:33335/ using document root <none> and password file <none>
I20260810 14:49:05.887866 31945 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:05.887913 31945 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:05.888034 31945 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:05.889025 31945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "940d9e243f06f0ed1ff20272247c9440"
server_key_iv: "472ef10c737556825e5134477196fc73"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.889346 31945 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "940d9e243f06f0ed1ff20272247c9440"
server_key_iv: "472ef10c737556825e5134477196fc73"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.890596 31945 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:05.891243 31966 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:05.891386 31945 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:05.891467 31945 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
format_stamp: "Formatted at 2026-08-10 14:49:05 on dist-test-slave-4tdj"
server_key: "940d9e243f06f0ed1ff20272247c9440"
server_key_iv: "472ef10c737556825e5134477196fc73"
server_key_version: "encryptionkey@0"
I20260810 14:49:05.891532 31945 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:05.909163 31945 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:05.911094 31945 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:05.911231 31945 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:05.911746 31945 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:05.911785 31945 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:05.911814 31945 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:05.911831 31945 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:49:05 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:05.918718 31945 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:43267
I20260810 14:49:05.919101 32169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:43267 every 8 connection(s)
I20260810 14:49:05.919152 31945 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:05.920915 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:05.912185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:58013 (local address 127.19.29.254:45329)
0810 14:49:05.912227 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:05.912229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:05.912450 (+ 221us) server_negotiation.cc:407] Connection header received
0810 14:49:05.912972 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:05.912973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:05.912987 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:05.913040 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:05.913857 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.914649 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.915733 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.916059 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.916139 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:05.918217 (+ 2078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:05.918219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:05.918219 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:05.918227 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:05.919765 (+ 1538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.920163 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.920164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.920164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.920230 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.920432 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.920432 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.920432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.920538 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:05.920586 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:05.920779 (+ 193us) server_negotiation.cc:299] Negotiation successful
0810 14:49:05.920851 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:05.921059 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:05.912180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.193:58013)
0810 14:49:05.912335 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:05.912370 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:05.912873 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:05.913132 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:05.913136 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:05.913466 (+ 330us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:05.913734 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:05.913742 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.914775 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.914776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:05.915656 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:05.915659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.916164 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.916165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:05.916311 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:05.916794 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:05.916805 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:05.918134 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:05.919831 (+ 1697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:05.919834 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:05.919835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:05.920076 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:05.920290 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:05.920290 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:05.920291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:05.920386 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:05.920577 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:05.920580 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:05.920685 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 14:49:05.920758 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 14:49:05.920874 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":78,"threads_started":1}
I20260810 14:49:05.921523 32171 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45329
I20260810 14:49:05.921605 32171 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:05.921780 32171 heartbeater.cc:511] Master 127.19.29.254:45329 requested a full tablet report, sending...
I20260810 14:49:05.922350 31830 ts_manager.cc:194] Registered new tserver with Master: 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267)
I20260810 14:49:05.923120 31830 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:58013
I20260810 14:49:05.926875 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 31945
I20260810 14:49:05.926975 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:05.927201 19575 external_mini_cluster.cc:1428] Setting key be27b40e152cdac735d828580e56be6a
I20260810 14:49:05.927693 32180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:05.922506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.193:37501)
0810 14:49:05.922651 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:05.922660 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:05.922715 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:05.922881 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:05.922883 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:05.923044 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:05.923100 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:05.923101 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.923759 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.923760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:05.924260 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:05.924261 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.924587 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.924588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:05.924648 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:05.925014 (+ 366us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:05.925019 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:05.925289 (+ 270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:05.926663 (+ 1374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:05.926664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:05.926664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:05.926888 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:05.927115 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:05.927116 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:05.927117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:05.927182 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:05.927422 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:05.927422 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:05.927467 (+ 45us) client_negotiation.cc:769] Sending connection context
0810 14:49:05.927545 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:49:05.927631 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260810 14:49:05.927754 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:05.922540 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:37501 (local address 127.19.29.254:45329)
0810 14:49:05.922600 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:05.922602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:05.922718 (+ 116us) server_negotiation.cc:407] Connection header received
0810 14:49:05.922769 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:05.922770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:05.922780 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:05.922843 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:05.923170 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.923662 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.924328 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:05.924529 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:05.924583 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:05.925365 (+ 782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:05.925366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:05.925367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:05.925374 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:05.926585 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.926969 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.926970 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.926970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.927051 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:05.927235 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:05.927236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:05.927236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:05.927357 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:05.927424 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:05.927578 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 14:49:05.927665 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
WARNING: no policy specified for oryx/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
I20260810 14:49:05.953612 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45329
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:06.034428 32188 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:06.034627 32188 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:06.034649 32188 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:06.035720 32188 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:06.035753 32188 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:06.035770 32188 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:49:06.035785 32188 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:06.037235 32188 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32188
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:06.037420 32188 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:06.037600 32188 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:06.042436 32206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:06.042413 32202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:06.042450 32188 server_base.cc:1034] running on GCE node
W20260810 14:49:06.042397 32201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:06.042896 32188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:06.043118 32188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:06.044250 32188 hybrid_clock.cc:648] HybridClock initialized: now 1786373346044237 us; error 29 us; skew 500 ppm
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:06.046703 32188 init.cc:377] Logged in from keytab as oryx/127.19.29.194@KRBTEST.COM (short username oryx)
I20260810 14:49:06.047117 32188 webserver.cc:460] Webserver started at http://127.19.29.194:37463/ using document root <none> and password file <none>
I20260810 14:49:06.047328 32188 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:06.047371 32188 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:06.047477 32188 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:06.048454 32188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "b6a20b0a2a34498bab62944942f335bc"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "c7e27e8d6617d39feb3f6450fc370031"
server_key_iv: "f84eba0c47e9cb70605cadc1e36b3cec"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.048756 32188 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "b6a20b0a2a34498bab62944942f335bc"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "c7e27e8d6617d39feb3f6450fc370031"
server_key_iv: "f84eba0c47e9cb70605cadc1e36b3cec"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.049974 32188 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:06.050696 32219 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.050832 32188 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.050905 32188 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "b6a20b0a2a34498bab62944942f335bc"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "c7e27e8d6617d39feb3f6450fc370031"
server_key_iv: "f84eba0c47e9cb70605cadc1e36b3cec"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.050966 32188 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:06.064576 32188 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:06.066632 32188 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:06.066751 32188 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:06.067229 32188 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:06.067278 32188 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.067301 32188 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:06.067312 32188 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:06.073701 32188 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:44411
I20260810 14:49:06.073830 32417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:44411 every 8 connection(s)
I20260810 14:49:06.074065 32188 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:49:06.076596 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.067728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:52983 (local address 127.19.29.254:45329)
0810 14:49:06.067777 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.067779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.067997 (+ 218us) server_negotiation.cc:407] Connection header received
0810 14:49:06.068556 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.068557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.068573 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.068639 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.069438 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.070179 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.071690 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.071974 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.072053 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.074187 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.074189 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.074189 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.074198 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.075549 (+ 1351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.075910 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.075910 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.075911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.075958 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.076120 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.076120 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.076120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.076215 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.076259 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.076448 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.076514 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:49:06.076720 32234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.067724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.194:52983)
0810 14:49:06.067875 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.067911 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.068405 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.068702 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.068707 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.069058 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:06.069335 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.069341 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.070276 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.070277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.071595 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.071599 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.072052 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.072053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.072149 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.072660 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:06.072670 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:06.074106 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:06.075627 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.075634 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.075636 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.075851 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.076000 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.076001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.076001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.076082 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.076258 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:06.076261 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:06.076360 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.076434 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.076546 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260810 14:49:06.077217 32418 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45329
I20260810 14:49:06.077302 32418 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:06.077466 32418 heartbeater.cc:511] Master 127.19.29.254:45329 requested a full tablet report, sending...
I20260810 14:49:06.077859 31831 ts_manager.cc:194] Registered new tserver with Master: b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411)
I20260810 14:49:06.078258 31831 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:52983
I20260810 14:49:06.078382 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 32188
I20260810 14:49:06.078477 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:49:06.078665 19575 external_mini_cluster.cc:1428] Setting key edc854a74c3df9b5c1154e7ad61d2a1b
I20260810 14:49:06.083331 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.078185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:44371 (local address 127.19.29.254:45329)
0810 14:49:06.078223 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.078224 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.078389 (+ 165us) server_negotiation.cc:407] Connection header received
0810 14:49:06.078411 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.078412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.078422 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.078475 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.078754 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.079354 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.079995 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.080189 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.080239 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.081004 (+ 765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.081005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.081005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.081012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.082250 (+ 1238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.082609 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.082610 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.082610 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.082660 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.082823 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.082824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.082824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.082966 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.083023 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.083174 (+ 151us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.083243 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:49:06.083336 32434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.078123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.194:44371)
0810 14:49:06.078264 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.078274 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.078351 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.078479 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.078480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.078643 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:06.078690 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.078692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.079443 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.079444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.079930 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.079932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.080244 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.080245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.080306 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.080667 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:06.080672 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:06.080926 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:06.082359 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.082360 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.082361 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.082523 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.082714 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.082715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.082716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.082774 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.083024 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:06.083025 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:06.083071 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.083144 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.083244 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
I20260810 14:49:06.104867 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45329
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:06.184917 32445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:06.185105 32445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:06.185127 32445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:06.186246 32445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:06.186307 32445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:06.186338 32445 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260810 14:49:06.186362 32445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:06.187940 32445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.19.29.254:45329
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:06.188180 32445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:06.188388 32445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:06.193188 32458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:06.193163 32459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:06.193295 32445 server_base.cc:1034] running on GCE node
W20260810 14:49:06.193185 32466 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:06.193583 32445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:06.193797 32445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:06.194927 32445 hybrid_clock.cc:648] HybridClock initialized: now 1786373346194914 us; error 30 us; skew 500 ppm
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:06.197290 32445 init.cc:377] Logged in from keytab as oryx/127.19.29.195@KRBTEST.COM (short username oryx)
I20260810 14:49:06.197739 32445 webserver.cc:460] Webserver started at http://127.19.29.195:33673/ using document root <none> and password file <none>
I20260810 14:49:06.197949 32445 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:06.197995 32445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:06.198122 32445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:06.199148 32445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "c56fc38a06294075bd631a3af07089e6"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "6ad7e7251d70ce6dbe721889abc85af0"
server_key_iv: "2b4acf3a89712e83bf65427b92ae33b8"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.199527 32445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "c56fc38a06294075bd631a3af07089e6"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "6ad7e7251d70ce6dbe721889abc85af0"
server_key_iv: "2b4acf3a89712e83bf65427b92ae33b8"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.200764 32445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:49:06.201419 32479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.201604 32445 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:06.201687 32445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "c56fc38a06294075bd631a3af07089e6"
format_stamp: "Formatted at 2026-08-10 14:49:06 on dist-test-slave-4tdj"
server_key: "6ad7e7251d70ce6dbe721889abc85af0"
server_key_iv: "2b4acf3a89712e83bf65427b92ae33b8"
server_key_version: "encryptionkey@0"
I20260810 14:49:06.201752 32445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:06.227943 32445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:06.230018 32445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:06.230151 32445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:06.230726 32445 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:06.230767 32445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.230795 32445 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:06.230826 32445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:06.237587 32445 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:37877
I20260810 14:49:06.237663 32692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:37877 every 8 connection(s)
I20260810 14:49:06.237977 32445 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:06.239823 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 32445
I20260810 14:49:06.239919 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:06.240113 19575 external_mini_cluster.cc:1428] Setting key 40fdcd0f375ae447945832a381e270da
I20260810 14:49:06.240653 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.231092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:59827 (local address 127.19.29.254:45329)
0810 14:49:06.231159 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.231161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.231356 (+ 195us) server_negotiation.cc:407] Connection header received
0810 14:49:06.231998 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.232000 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.232011 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.232051 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.232894 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.233440 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.234520 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.234728 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.234786 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.237653 (+ 2867us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.237654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.237655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.237663 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.239255 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.239648 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.239648 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.239649 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.239699 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.239976 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.239977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.239978 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.240096 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.240149 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.240475 (+ 326us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.240556 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:49:06.240832 32494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.231070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.195:59827)
0810 14:49:06.231218 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.231263 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.231886 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.232136 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.232140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.232476 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:06.232769 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.232776 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.233543 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.233545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.234431 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.234435 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.234815 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.234817 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.234930 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.235387 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:06.235397 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:06.237560 (+ 2163us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:06.239343 (+ 1783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.239351 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.239353 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.239581 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.239755 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.239756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.239756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.239897 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.240160 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:06.240167 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:06.240326 (+ 159us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.240445 (+ 119us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.240612 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":73,"threads_started":1}
I20260810 14:49:06.241320 32693 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45329
I20260810 14:49:06.241401 32693 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:06.241598 32693 heartbeater.cc:511] Master 127.19.29.254:45329 requested a full tablet report, sending...
I20260810 14:49:06.241995 31831 ts_manager.cc:194] Registered new tserver with Master: c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.242515 31831 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:59827
I20260810 14:49:06.247056 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.242320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:49649 (local address 127.19.29.254:45329)
0810 14:49:06.242356 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.242358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.242436 (+ 78us) server_negotiation.cc:407] Connection header received
0810 14:49:06.242518 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.242519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.242527 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.242567 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.242871 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.243485 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.244155 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.244323 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.244369 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.245168 (+ 799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.245169 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.245169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.245173 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.246184 (+ 1011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.246553 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.246554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.246554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.246601 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.246729 (+ 128us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.246730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.246730 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.246813 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.246853 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.246937 (+ 84us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.246988 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:49:06.247062 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.242222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.19.29.195:49649)
0810 14:49:06.242377 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.242388 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.242451 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.242577 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.242578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.242759 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:06.242812 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.242814 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.243580 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.243580 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.244083 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.244084 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.244376 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.244377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.244424 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.244817 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:06.244823 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:06.245101 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:06.246257 (+ 1156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.246259 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.246259 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.246491 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.246643 (+ 152us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.246644 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.246644 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.246692 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.246846 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:06.246847 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:06.246879 (+ 32us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.246921 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.246994 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260810 14:49:06.252033 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:49:06.273134 31937 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:06.268021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34352 (local address 127.19.29.254:45329)
0810 14:49:06.268073 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.268075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.268085 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:06.268139 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.268140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.268149 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.268195 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.268717 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.269207 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.269951 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.270135 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.270176 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.273052 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34352: BlockingRecv error: recv got EOF from 127.0.0.1:34352 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:06.279935 31937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.273761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34356 (local address 127.19.29.254:45329)
0810 14:49:06.273797 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.273798 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.273843 (+ 45us) server_negotiation.cc:407] Connection header received
0810 14:49:06.273893 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.273893 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.273901 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.273948 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.274396 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.274896 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.275600 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.275786 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.275848 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.277812 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.277813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.277813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.277820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.279091 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.279374 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.279374 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.279375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.279417 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.279547 (+ 130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.279547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.279547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.279644 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.279737 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.279796 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.279856 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:49:06.281418 31831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:06.283179 31831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:06.289724 32737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:37877 (local address 127.0.0.1:58986)
0810 14:49:06.286104 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.286113 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.286216 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.286486 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.286486 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.286488 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.286519 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.286520 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287701 (+ 1181us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.287702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.288784 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.288785 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289429 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.289506 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289520 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.289593 (+ 73us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.289647 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":248,"thread_start_us":67,"threads_started":1}
I20260810 14:49:06.289741 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58986 (local address 127.19.29.195:37877)
0810 14:49:06.286147 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.286151 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.286162 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:49:06.286333 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.286336 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.286352 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.286417 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.286581 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287619 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.288879 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289352 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289412 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289490 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.289614 (+ 124us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.289651 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":81,"threads_started":1}
I20260810 14:49:06.289836 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.0.0.1:43584)
0810 14:49:06.285956 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.285964 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.286010 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.286384 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.286385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.286387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.286439 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.286441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287448 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.287449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.288608 (+ 1159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.288611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289605 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.289677 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289681 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.289725 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.289764 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":19,"thread_start_us":78,"threads_started":1}
I20260810 14:49:06.289924 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43267 (local address 127.0.0.1:60510)
0810 14:49:06.285618 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.285660 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.285723 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.286055 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.286058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.286061 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.286130 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.286132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287486 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.287487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.288778 (+ 1291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.288781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289746 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289746 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.289796 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289799 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.289838 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.289871 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":33,"thread_start_us":54,"threads_started":1}
I20260810 14:49:06.290086 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43584 (local address 127.19.29.194:44411)
0810 14:49:06.286183 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.286188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.286198 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:06.286238 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.286240 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.286255 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.286515 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.286592 (+ 77us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287370 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.288718 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289407 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289474 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289565 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.289949 (+ 384us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.289991 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":329,"thread_start_us":84,"threads_started":1}
I20260810 14:49:06.290213 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.285612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60510 (local address 127.19.29.193:43267)
0810 14:49:06.285812 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.285818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.285828 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:06.285870 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.285873 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.285889 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.285972 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.286233 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.287392 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.288871 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.289586 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.289648 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.289714 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.290081 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.290120 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":84,"threads_started":1}
I20260810 14:49:06.290843 32063 tablet_service.cc:1467] Processing CreateTablet for tablet 278317c72d854991830d70fc87a346f6 (DEFAULT_TABLE table=test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.290843 32297 tablet_service.cc:1467] Processing CreateTablet for tablet 278317c72d854991830d70fc87a346f6 (DEFAULT_TABLE table=test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.291211 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278317c72d854991830d70fc87a346f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.291211 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278317c72d854991830d70fc87a346f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.294937 32749 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Bootstrap starting.
I20260810 14:49:06.295363 32577 tablet_service.cc:1467] Processing CreateTablet for tablet 278317c72d854991830d70fc87a346f6 (DEFAULT_TABLE table=test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.295490 32749 tablet_bootstrap.cc:654] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.295630 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 278317c72d854991830d70fc87a346f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.295735 32749 log.cc:824] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:06.296379 32749 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: No bootstrap required, opened a new log
I20260810 14:49:06.296440 32749 ts_tablet_manager.cc:1397] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:49:06.297133 32754 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Bootstrap starting.
I20260810 14:49:06.297804 32754 tablet_bootstrap.cc:654] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.298122 32754 log.cc:824] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:06.298476 32749 raft_consensus.cc:348] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.298614 32749 raft_consensus.cc:374] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.298658 32749 raft_consensus.cc:729] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.298786 32749 consensus_queue.cc:260] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.298920 32754 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: No bootstrap required, opened a new log
I20260810 14:49:06.298987 32754 ts_tablet_manager.cc:1397] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:49:06.299079 32749 ts_tablet_manager.cc:1428] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:49:06.299105 32418 heartbeater.cc:503] Master 127.19.29.254:45329 was elected leader, sending a full tablet report...
I20260810 14:49:06.299263 32760 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Bootstrap starting.
I20260810 14:49:06.299827 32760 tablet_bootstrap.cc:654] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.300154 32760 log.cc:824] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:06.300872 32760 tablet_bootstrap.cc:492] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: No bootstrap required, opened a new log
I20260810 14:49:06.300945 32760 ts_tablet_manager.cc:1397] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:49:06.300904 32754 raft_consensus.cc:348] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.301051 32754 raft_consensus.cc:374] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.301091 32754 raft_consensus.cc:729] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.301201 32754 consensus_queue.cc:260] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.301451 32754 ts_tablet_manager.cc:1428] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:49:06.301473 32171 heartbeater.cc:503] Master 127.19.29.254:45329 was elected leader, sending a full tablet report...
I20260810 14:49:06.302574 32760 raft_consensus.cc:348] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.302690 32760 raft_consensus.cc:374] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.302709 32760 raft_consensus.cc:729] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.302789 32760 consensus_queue.cc:260] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.302994 32760 ts_tablet_manager.cc:1428] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:06.303037 32693 heartbeater.cc:503] Master 127.19.29.254:45329 was elected leader, sending a full tablet report...
W20260810 14:49:06.324625 32419 tablet.cc:2369] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:49:06.419888 32172 tablet.cc:2369] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:49:06.468753 32763 raft_consensus.cc:482] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:06.468888 32763 raft_consensus.cc:504] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.469276 32763 leader_election.cc:288] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.472244 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.469782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:50807 (local address 127.19.29.195:37877)
0810 14:49:06.469828 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.469830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.469837 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:06.469882 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.469883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.469892 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.469945 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.470091 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.470593 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.471587 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.471942 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.472004 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.472012 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.472149 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.472181 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:49:06.472250 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.469583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:37345 (local address 127.19.29.194:44411)
0810 14:49:06.469642 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.469644 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.469670 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:49:06.469816 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.469819 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.469830 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.469884 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.470045 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.470594 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.471587 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.471934 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.471992 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.472001 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.472140 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.472181 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:49:06.472285 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.469662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:37877 (local address 127.19.29.193:50807)
0810 14:49:06.469763 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.469773 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.469826 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.469960 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.469960 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.469962 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.470022 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.470024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.470667 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.470668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.471499 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.471501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.472017 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.472018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.472085 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.472088 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.472145 (+ 57us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.472184 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":29,"thread_start_us":44,"threads_started":1}
I20260810 14:49:06.472292 32767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.469467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.19.29.193:37345)
0810 14:49:06.469602 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.469615 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.469690 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.469895 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.469896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.469899 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.469975 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.469981 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.470669 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.470670 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.471502 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.471505 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.472001 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.472002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.472076 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.472080 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.472125 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.472167 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":48,"thread_start_us":66,"threads_started":1}
I20260810 14:49:06.472605 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278317c72d854991830d70fc87a346f6" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6" is_pre_election: true
I20260810 14:49:06.472783 32607 raft_consensus.cc:2454] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 0.
I20260810 14:49:06.473009 31970 leader_election.cc:302] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, c56fc38a06294075bd631a3af07089e6; no voters:
I20260810 14:49:06.473119 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278317c72d854991830d70fc87a346f6" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc" is_pre_election: true
I20260810 14:49:06.473129 32763 raft_consensus.cc:2781] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:06.473215 32763 raft_consensus.cc:482] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:06.473249 32763 raft_consensus.cc:3037] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.473270 32336 raft_consensus.cc:2454] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 0.
I20260810 14:49:06.474025 32763 raft_consensus.cc:504] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.474140 32763 leader_election.cc:288] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 election: Requested vote from peers b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.474341 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278317c72d854991830d70fc87a346f6" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc"
I20260810 14:49:06.474416 32336 raft_consensus.cc:3037] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.474395 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "278317c72d854991830d70fc87a346f6" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6"
I20260810 14:49:06.474472 32607 raft_consensus.cc:3037] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.475098 32336 raft_consensus.cc:2454] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 1.
I20260810 14:49:06.475169 32607 raft_consensus.cc:2454] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 1.
I20260810 14:49:06.475260 31970 leader_election.cc:302] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, b6a20b0a2a34498bab62944942f335bc; no voters:
I20260810 14:49:06.475394 32763 raft_consensus.cc:2781] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:06.475498 32763 raft_consensus.cc:686] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Running, Role: LEADER
I20260810 14:49:06.475589 32763 consensus_queue.cc:237] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.476346 31831 catalog_manager.cc:5495] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } health_report { overall_health: UNKNOWN } } }
W20260810 14:49:06.488534 32695 tablet.cc:2369] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:49:06.513540 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.511273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60514 (local address 127.19.29.193:43267)
0810 14:49:06.511338 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.511340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.511349 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:06.511388 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.511389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.511405 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.511490 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:06.511622 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.512085 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.512830 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.513018 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.513073 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.513237 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.513335 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.513403 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.513440 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.513460 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:49:06.515404 32607 raft_consensus.cc:1261] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Refusing update from remote peer 38be2a340b1f4f0b98a35c0ef8a8e2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.515398 32336 raft_consensus.cc:1261] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Refusing update from remote peer 38be2a340b1f4f0b98a35c0ef8a8e2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.515745 301 consensus_queue.cc:1035] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.515879 32763 consensus_queue.cc:1035] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.518098 305 mvcc.cc:205] Tried to move back new op lower bound from 7316985227324334080 to 7316985227164626944. Current Snapshot: MvccSnapshot[applied={T|T < 7316985227324334080}]
I20260810 14:49:06.518726 307 mvcc.cc:205] Tried to move back new op lower bound from 7316985227324334080 to 7316985227164626944. Current Snapshot: MvccSnapshot[applied={T|T < 7316985227324334080}]
I20260810 14:49:06.519418 306 mvcc.cc:205] Tried to move back new op lower bound from 7316985227324334080 to 7316985227164626944. Current Snapshot: MvccSnapshot[applied={T|T < 7316985227324334080 or (T in {7316985227324334080})}]
I20260810 14:49:06.520526 31831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:06.520625 31831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:06.521384 31831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Sending DeleteTablet for 3 replicas of tablet 278317c72d854991830d70fc87a346f6
I20260810 14:49:06.521806 32577 tablet_service.cc:1514] Processing DeleteTablet for tablet 278317c72d854991830d70fc87a346f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:58986
I20260810 14:49:06.521816 32297 tablet_service.cc:1514] Processing DeleteTablet for tablet 278317c72d854991830d70fc87a346f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43584
I20260810 14:49:06.522025 32063 tablet_service.cc:1514] Processing DeleteTablet for tablet 278317c72d854991830d70fc87a346f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60510
I20260810 14:49:06.522259 317 tablet_replica.cc:330] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: stopping tablet replica
I20260810 14:49:06.522265 323 tablet_replica.cc:330] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: stopping tablet replica
I20260810 14:49:06.522401 323 raft_consensus.cc:2229] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:06.522432 317 raft_consensus.cc:2229] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:06.522493 31831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260810 14:49:06.522557 323 raft_consensus.cc:2258] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:06.522588 317 raft_consensus.cc:2258] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260810 14:49:06.522639 31831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:06.523080 323 ts_tablet_manager.cc:1905] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.523344 315 tablet_replica.cc:330] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: stopping tablet replica
I20260810 14:49:06.523478 315 raft_consensus.cc:2229] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:06.523607 315 raft_consensus.cc:2258] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:06.524026 315 ts_tablet_manager.cc:1905] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.524570 32297 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (DEFAULT_TABLE table=test-table [id=c0ef2639415c4eb29aa702777315177d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.524611 32063 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (DEFAULT_TABLE table=test-table [id=c0ef2639415c4eb29aa702777315177d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.524679 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.524724 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.525007 323 ts_tablet_manager.cc:1918] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:06.525084 323 log.cc:1196] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/278317c72d854991830d70fc87a346f6
I20260810 14:49:06.525377 323 ts_tablet_manager.cc:1939] T 278317c72d854991830d70fc87a346f6 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting consensus metadata
I20260810 14:49:06.525931 32749 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Bootstrap starting.
I20260810 14:49:06.526003 32577 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (DEFAULT_TABLE table=test-table [id=c0ef2639415c4eb29aa702777315177d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.526111 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.526383 32749 tablet_bootstrap.cc:654] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.526716 32754 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Bootstrap starting.
I20260810 14:49:06.527107 32754 tablet_bootstrap.cc:654] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.527226 315 ts_tablet_manager.cc:1918] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:06.527290 315 log.cc:1196] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/278317c72d854991830d70fc87a346f6
I20260810 14:49:06.527539 315 ts_tablet_manager.cc:1939] T 278317c72d854991830d70fc87a346f6 P b6a20b0a2a34498bab62944942f335bc: Deleting consensus metadata
I20260810 14:49:06.527539 32760 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Bootstrap starting.
I20260810 14:49:06.527846 32749 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: No bootstrap required, opened a new log
I20260810 14:49:06.527918 32749 ts_tablet_manager.cc:1397] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:49:06.527935 32760 tablet_bootstrap.cc:654] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.528034 31806 catalog_manager.cc:4841] TS b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411): tablet 278317c72d854991830d70fc87a346f6 (table test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]) successfully deleted
I20260810 14:49:06.528079 32749 raft_consensus.cc:348] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.528151 32749 raft_consensus.cc:374] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.528173 32749 raft_consensus.cc:729] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.528225 32749 consensus_queue.cc:260] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.528316 32749 ts_tablet_manager.cc:1428] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:06.528344 31806 catalog_manager.cc:4841] TS 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267): tablet 278317c72d854991830d70fc87a346f6 (table test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]) successfully deleted
I20260810 14:49:06.528842 317 ts_tablet_manager.cc:1905] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.530048 317 ts_tablet_manager.cc:1918] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:06.530172 317 log.cc:1196] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/278317c72d854991830d70fc87a346f6
I20260810 14:49:06.530211 32760 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: No bootstrap required, opened a new log
I20260810 14:49:06.530331 32760 ts_tablet_manager.cc:1397] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 14:49:06.530498 32760 raft_consensus.cc:348] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.530551 317 ts_tablet_manager.cc:1939] T 278317c72d854991830d70fc87a346f6 P c56fc38a06294075bd631a3af07089e6: Deleting consensus metadata
I20260810 14:49:06.530622 32754 tablet_bootstrap.cc:492] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: No bootstrap required, opened a new log
I20260810 14:49:06.530558 32760 raft_consensus.cc:374] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.530668 32760 raft_consensus.cc:729] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.530671 32754 ts_tablet_manager.cc:1397] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260810 14:49:06.530711 32760 consensus_queue.cc:260] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.530791 32760 ts_tablet_manager.cc:1428] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.530810 32754 raft_consensus.cc:348] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.530877 32754 raft_consensus.cc:374] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.530900 32754 raft_consensus.cc:729] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.530948 32754 consensus_queue.cc:260] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.531051 32754 ts_tablet_manager.cc:1428] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:06.531193 31806 catalog_manager.cc:4841] TS c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877): tablet 278317c72d854991830d70fc87a346f6 (table test-table [id=1e3d04a4e1cb4da0a595aabbb4d836a4]) successfully deleted
I20260810 14:49:06.778533 32763 raft_consensus.cc:482] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:06.778642 32763 raft_consensus.cc:504] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.778803 32763 leader_election.cc:288] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.779081 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4cd3af7a2c42a19249b5847c3dfbf5" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6" is_pre_election: true
I20260810 14:49:06.779081 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4cd3af7a2c42a19249b5847c3dfbf5" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc" is_pre_election: true
I20260810 14:49:06.779212 32607 raft_consensus.cc:2454] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 0.
I20260810 14:49:06.779212 32336 raft_consensus.cc:2454] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 0.
I20260810 14:49:06.779384 31970 leader_election.cc:302] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, c56fc38a06294075bd631a3af07089e6; no voters:
I20260810 14:49:06.779522 32763 raft_consensus.cc:2781] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:06.779579 32763 raft_consensus.cc:482] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:06.779599 32763 raft_consensus.cc:3037] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.780272 32763 raft_consensus.cc:504] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.780388 32763 leader_election.cc:288] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 election: Requested vote from peers b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.780604 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4cd3af7a2c42a19249b5847c3dfbf5" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc"
I20260810 14:49:06.780680 32336 raft_consensus.cc:3037] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.780642 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4cd3af7a2c42a19249b5847c3dfbf5" candidate_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6"
I20260810 14:49:06.780721 32607 raft_consensus.cc:3037] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.781292 32336 raft_consensus.cc:2454] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 1.
I20260810 14:49:06.781384 32607 raft_consensus.cc:2454] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38be2a340b1f4f0b98a35c0ef8a8e2a2 in term 1.
I20260810 14:49:06.781477 31970 leader_election.cc:302] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, b6a20b0a2a34498bab62944942f335bc; no voters:
I20260810 14:49:06.781570 32763 raft_consensus.cc:2781] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:06.781641 32763 raft_consensus.cc:686] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 LEADER]: Becoming Leader. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Running, Role: LEADER
I20260810 14:49:06.781710 32763 consensus_queue.cc:237] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.782411 31826 catalog_manager.cc:5495] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373345, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.254@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:06.833350 338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.826969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34358 (local address 127.19.29.254:45329)
0810 14:49:06.827087 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.827089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.827136 (+ 47us) server_negotiation.cc:407] Connection header received
0810 14:49:06.827194 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.827194 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.827203 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.827253 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.827674 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.828182 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.828847 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.829055 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.829117 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.831109 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.831111 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.831111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.831118 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.832345 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.832708 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.832709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.832709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.832770 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.832933 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.832933 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.832933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.833036 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.833081 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.833201 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.833279 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260810 14:49:06.833464 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.826909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45329 (local address 127.0.0.1:34358)
0810 14:49:06.827076 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.827085 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.827140 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.827268 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.827268 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.827572 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:06.827617 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.827620 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.828239 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.828239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.828763 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.828764 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.829122 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.829123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.829164 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.829615 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:06.829619 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:06.831016 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:06.832415 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.832423 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.832426 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.832643 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.832819 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:06.832820 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:06.832820 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:06.832882 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:06.833081 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:06.833087 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:06.833128 (+ 41us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.833181 (+ 53us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.833342 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":61,"thread_start_us":67,"threads_started":1}
I20260810 14:49:06.835300 31826 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:34358:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260810 14:49:06.835491 31826 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:06.836790 32063 tablet_service.cc:1467] Processing CreateTablet for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=38158117e1cd47e39c03e98f27caef33]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:49:06.836838 32297 tablet_service.cc:1467] Processing CreateTablet for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=38158117e1cd47e39c03e98f27caef33]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:49:06.836838 32577 tablet_service.cc:1467] Processing CreateTablet for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=38158117e1cd47e39c03e98f27caef33]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260810 14:49:06.836963 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.836971 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.836983 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce10be8bcdc44ad7a4e41ea6fa9b64ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.838188 32760 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: Bootstrap starting.
I20260810 14:49:06.838478 32749 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: Bootstrap starting.
I20260810 14:49:06.838616 32760 tablet_bootstrap.cc:654] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.838881 32749 tablet_bootstrap.cc:654] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.839216 32754 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Bootstrap starting.
I20260810 14:49:06.839357 32760 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: No bootstrap required, opened a new log
I20260810 14:49:06.839398 32760 ts_tablet_manager.cc:1397] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:06.839473 32749 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: No bootstrap required, opened a new log
I20260810 14:49:06.839511 32749 ts_tablet_manager.cc:1397] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:06.839550 32754 tablet_bootstrap.cc:654] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.839552 32760 raft_consensus.cc:348] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.839617 32760 raft_consensus.cc:374] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.839636 32760 raft_consensus.cc:729] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.839648 32749 raft_consensus.cc:348] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.839681 32760 consensus_queue.cc:260] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.839710 32749 raft_consensus.cc:374] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.839730 32749 raft_consensus.cc:729] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.839773 32760 ts_tablet_manager.cc:1428] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:06.839771 32749 consensus_queue.cc:260] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.839847 32749 ts_tablet_manager.cc:1428] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.839838 32765 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.839920 32765 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.840166 32754 tablet_bootstrap.cc:492] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: No bootstrap required, opened a new log
I20260810 14:49:06.840135 32761 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.840212 32754 ts_tablet_manager.cc:1397] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:06.840212 32761 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.840312 32754 raft_consensus.cc:348] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.840371 32754 raft_consensus.cc:374] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.840387 32754 raft_consensus.cc:729] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.840428 32754 consensus_queue.cc:260] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.840512 32754 ts_tablet_manager.cc:1428] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.840538 32763 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.840631 32763 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.877369 32761 raft_consensus.cc:482] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:06.877455 32761 raft_consensus.cc:504] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.877810 32761 leader_election.cc:288] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.880739 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.878041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:33155 (local address 127.19.29.193:43267)
0810 14:49:06.878111 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.878113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.878241 (+ 128us) server_negotiation.cc:407] Connection header received
0810 14:49:06.878344 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.878345 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.878357 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.878401 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.878567 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.879041 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880069 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.880421 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880474 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.880481 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.880637 (+ 156us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.880675 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 14:49:06.880752 347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.877959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43267 (local address 127.19.29.194:33155)
0810 14:49:06.878155 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.878169 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.878247 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.878417 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.878418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.878421 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.878495 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.878498 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.879114 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.879116 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.879975 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.879978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.880494 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880496 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.880563 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.880568 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.880627 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.880663 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"mutex_wait_us":40,"thread_start_us":89,"threads_started":1}
I20260810 14:49:06.880795 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.878249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:38187 (local address 127.19.29.195:37877)
0810 14:49:06.878315 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.878316 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.878326 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:06.878378 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.878379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.878388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.878444 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:06.878571 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.879041 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880049 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.880494 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880569 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.880578 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.880698 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.880734 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:49:06.881003 350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.878153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:37877 (local address 127.19.29.194:38187)
0810 14:49:06.878241 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.878251 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.878318 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.878447 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.878447 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.878449 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:06.878513 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.878514 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.879118 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.879119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.879965 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.879967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.880577 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.880578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.880630 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.880634 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.880686 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.880723 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":30,"thread_start_us":40,"threads_started":1}
I20260810 14:49:06.881044 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce10be8bcdc44ad7a4e41ea6fa9b64ae" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" is_pre_election: true
I20260810 14:49:06.881170 32099 raft_consensus.cc:2454] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 0.
I20260810 14:49:06.881354 32226 leader_election.cc:302] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, b6a20b0a2a34498bab62944942f335bc; no voters:
I20260810 14:49:06.881423 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce10be8bcdc44ad7a4e41ea6fa9b64ae" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6" is_pre_election: true
I20260810 14:49:06.881494 32761 raft_consensus.cc:2781] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:06.881515 32607 raft_consensus.cc:2454] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 0.
I20260810 14:49:06.881544 32761 raft_consensus.cc:482] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:06.881573 32761 raft_consensus.cc:3037] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.882270 32761 raft_consensus.cc:504] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.882431 32761 leader_election.cc:288] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 election: Requested vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:06.882588 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce10be8bcdc44ad7a4e41ea6fa9b64ae" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
I20260810 14:49:06.882589 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce10be8bcdc44ad7a4e41ea6fa9b64ae" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6"
I20260810 14:49:06.882661 32607 raft_consensus.cc:3037] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.882661 32099 raft_consensus.cc:3037] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:06.883267 32607 raft_consensus.cc:2454] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 1.
I20260810 14:49:06.883436 32226 leader_election.cc:302] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6a20b0a2a34498bab62944942f335bc, c56fc38a06294075bd631a3af07089e6; no voters:
I20260810 14:49:06.883461 32099 raft_consensus.cc:2454] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 1.
I20260810 14:49:06.883644 32761 raft_consensus.cc:2781] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:06.883781 32761 raft_consensus.cc:686] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [term 1 LEADER]: Becoming Leader. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Running, Role: LEADER
I20260810 14:49:06.883857 32761 consensus_queue.cc:237] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.884215 353 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: TxnStatusTablet state changed. Reason: New leader b6a20b0a2a34498bab62944942f335bc. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.884301 353 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:49:06.884500 356 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260810 14:49:06.884616 356 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260810 14:49:06.884580 31826 catalog_manager.cc:5495] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc reported cstate change: term changed from 0 to 1, leader changed from <none> to b6a20b0a2a34498bab62944942f335bc (127.19.29.194). New cstate: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } health_report { overall_health: UNKNOWN } } }
I20260810 14:49:06.900385 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.897683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.19.29.194:44411)
0810 14:49:06.897728 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.897730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.897787 (+ 57us) server_negotiation.cc:407] Connection header received
0810 14:49:06.897877 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.897878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.897895 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.897950 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:06.898096 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.898619 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.899672 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.899851 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.899900 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.900099 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.900190 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.900237 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.900315 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.900332 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:49:06.900449 337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.897635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.0.0.1:43600)
0810 14:49:06.897735 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.897746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.897803 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.897970 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.897971 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.897972 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:49:06.898037 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.898039 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.898685 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.898686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.899588 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.899591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.899915 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.899916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.899982 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.900003 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.900246 (+ 243us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.900253 (+ 7us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.900314 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.900365 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260810 14:49:06.901396 32607 raft_consensus.cc:1261] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Refusing update from remote peer b6a20b0a2a34498bab62944942f335bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.901551 32099 raft_consensus.cc:1261] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Refusing update from remote peer b6a20b0a2a34498bab62944942f335bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.901652 353 consensus_queue.cc:1035] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.901803 32761 consensus_queue.cc:1035] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.902261 32765 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: TxnStatusTablet state changed. Reason: New leader b6a20b0a2a34498bab62944942f335bc. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.902391 32765 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.902601 32763 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: TxnStatusTablet state changed. Reason: New leader b6a20b0a2a34498bab62944942f335bc. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.902693 32763 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.903360 353 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.903465 353 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:49:06.903620 353 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.903707 353 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P b6a20b0a2a34498bab62944942f335bc: This TxnStatusTablet replica's current role is: LEADER
I20260810 14:49:06.903823 32763 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.903904 32763 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P 38be2a340b1f4f0b98a35c0ef8a8e2a2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.904011 32765 tablet_replica.cc:439] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } } }
I20260810 14:49:06.904083 32765 tablet_replica.cc:442] T ce10be8bcdc44ad7a4e41ea6fa9b64ae P c56fc38a06294075bd631a3af07089e6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260810 14:49:06.910352 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.907676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:51889 (local address 127.19.29.194:44411)
0810 14:49:06.907727 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.907729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.907828 (+ 99us) server_negotiation.cc:407] Connection header received
0810 14:49:06.907895 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.907895 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.907904 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.907945 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:06.908070 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.908495 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.909622 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.909804 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.909864 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.910113 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.910142 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.910183 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.910255 (+ 72us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.910273 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:49:06.910423 370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.907596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.19.29.193:51889)
0810 14:49:06.907752 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.907764 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.907832 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.907952 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.907953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.907955 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:49:06.908009 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.908011 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.908578 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.908579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.909496 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.909499 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.909907 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.909909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.909978 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.909996 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.910198 (+ 202us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.910200 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.910249 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.910328 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260810 14:49:06.912556 32607 raft_consensus.cc:1261] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Refusing update from remote peer 38be2a340b1f4f0b98a35c0ef8a8e2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.912698 32336 raft_consensus.cc:1261] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Refusing update from remote peer 38be2a340b1f4f0b98a35c0ef8a8e2a2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:06.912775 301 consensus_queue.cc:1035] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.912868 32763 consensus_queue.cc:1035] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:06.923583 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.918280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:43323 (local address 127.19.29.193:43267)
0810 14:49:06.918343 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.918345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.918566 (+ 221us) server_negotiation.cc:407] Connection header received
0810 14:49:06.921346 (+ 2780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.921347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.921377 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.921423 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:06.921553 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.922014 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.922806 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.923069 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.923130 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.923379 (+ 249us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.923407 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.923437 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.923490 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.923536 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:49:06.923632 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.918232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43267 (local address 127.19.29.194:43323)
0810 14:49:06.918496 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:06.918507 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:06.921270 (+ 2763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:06.921431 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:06.921432 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:06.921434 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:49:06.921499 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.921500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.922079 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.922080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.922731 (+ 651us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:06.922733 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.923190 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.923191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:06.923278 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.923297 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:49:06.923441 (+ 144us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:49:06.923442 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:49:06.923487 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:49:06.923530 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":157,"threads_started":1}
I20260810 14:49:06.933877 31831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:06.933975 31831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:34356:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:06.934567 31831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Sending DeleteTablet for 3 replicas of tablet 4b4cd3af7a2c42a19249b5847c3dfbf5
I20260810 14:49:06.934813 32063 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60510
I20260810 14:49:06.934866 32577 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:58986
I20260810 14:49:06.934990 323 tablet_replica.cc:330] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: stopping tablet replica
I20260810 14:49:06.935048 323 raft_consensus.cc:2229] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:06.935122 323 raft_consensus.cc:2258] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:06.935194 317 tablet_replica.cc:330] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: stopping tablet replica
I20260810 14:49:06.935252 317 raft_consensus.cc:2229] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:06.935289 317 raft_consensus.cc:2258] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:06.935549 323 ts_tablet_manager.cc:1905] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.937211 317 ts_tablet_manager.cc:1905] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.937386 323 ts_tablet_manager.cc:1918] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:49:06.937444 323 log.cc:1196] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/4b4cd3af7a2c42a19249b5847c3dfbf5
I20260810 14:49:06.937654 323 ts_tablet_manager.cc:1939] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting consensus metadata
I20260810 14:49:06.937947 31806 catalog_manager.cc:4841] TS 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267): tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (table test-table [id=c0ef2639415c4eb29aa702777315177d]) successfully deleted
I20260810 14:49:06.938388 32297 tablet_service.cc:1514] Processing DeleteTablet for tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:06 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43584
I20260810 14:49:06.938498 315 tablet_replica.cc:330] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: stopping tablet replica
I20260810 14:49:06.938556 315 raft_consensus.cc:2229] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:06.938612 315 raft_consensus.cc:2258] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:06.938727 317 ts_tablet_manager.cc:1918] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:49:06.938783 317 log.cc:1196] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/4b4cd3af7a2c42a19249b5847c3dfbf5
I20260810 14:49:06.938931 315 ts_tablet_manager.cc:1905] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:06.938975 317 ts_tablet_manager.cc:1939] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P c56fc38a06294075bd631a3af07089e6: Deleting consensus metadata
I20260810 14:49:06.939304 31806 catalog_manager.cc:4841] TS c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877): tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (table test-table [id=c0ef2639415c4eb29aa702777315177d]) successfully deleted
I20260810 14:49:06.940281 315 ts_tablet_manager.cc:1918] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:49:06.940332 315 log.cc:1196] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/4b4cd3af7a2c42a19249b5847c3dfbf5
I20260810 14:49:06.940502 315 ts_tablet_manager.cc:1939] T 4b4cd3af7a2c42a19249b5847c3dfbf5 P b6a20b0a2a34498bab62944942f335bc: Deleting consensus metadata
I20260810 14:49:06.940807 31806 catalog_manager.cc:4841] TS b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411): tablet 4b4cd3af7a2c42a19249b5847c3dfbf5 (table test-table [id=c0ef2639415c4eb29aa702777315177d]) successfully deleted
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:49:06.960081 338 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:06.954543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34364 (local address 127.19.29.254:45329)
0810 14:49:06.954586 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.954588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.954749 (+ 161us) server_negotiation.cc:407] Connection header received
0810 14:49:06.954816 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.954817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.954835 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.954930 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.955532 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.956264 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.956984 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.957205 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.957260 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.960015 (+ 2755us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34364: BlockingRecv error: recv got EOF from 127.0.0.1:34364 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 10 14:49:06 dist-test-slave-4tdj krb5kdc[31748](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373346, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM
I20260810 14:49:06.967355 338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:06.960815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34368 (local address 127.19.29.254:45329)
0810 14:49:06.960858 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:06.960859 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:06.960866 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:06.960923 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:06.960924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:06.960935 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:06.960976 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:06.961394 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.961849 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.962640 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:06.962833 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:06.962884 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:06.965084 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:06.965085 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:06.965085 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:06.965092 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:06.966351 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.966707 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.966707 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.966708 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.966750 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:06.966930 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:06.966930 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:06.966930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:06.967015 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:06.967081 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:06.967239 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:49:06.967297 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 14:49:06.968823 31831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:06.968979 31831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:06.970248 32297 tablet_service.cc:1467] Processing CreateTablet for tablet 80136da66c53438b912abde13525c15d (DEFAULT_TABLE table=test-table [id=c84bddd71e134b14b4f30fd47e1e8633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.970271 32577 tablet_service.cc:1467] Processing CreateTablet for tablet 80136da66c53438b912abde13525c15d (DEFAULT_TABLE table=test-table [id=c84bddd71e134b14b4f30fd47e1e8633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.970418 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80136da66c53438b912abde13525c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.970430 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80136da66c53438b912abde13525c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.970410 32063 tablet_service.cc:1467] Processing CreateTablet for tablet 80136da66c53438b912abde13525c15d (DEFAULT_TABLE table=test-table [id=c84bddd71e134b14b4f30fd47e1e8633]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:06.970520 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80136da66c53438b912abde13525c15d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:06.971737 32754 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Bootstrap starting.
I20260810 14:49:06.971833 32760 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Bootstrap starting.
I20260810 14:49:06.972071 32754 tablet_bootstrap.cc:654] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.972280 32760 tablet_bootstrap.cc:654] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.972635 32749 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Bootstrap starting.
I20260810 14:49:06.972685 32754 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: No bootstrap required, opened a new log
I20260810 14:49:06.972730 32754 ts_tablet_manager.cc:1397] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:06.972831 32754 raft_consensus.cc:348] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.972890 32754 raft_consensus.cc:374] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.972908 32754 raft_consensus.cc:729] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.972944 32754 consensus_queue.cc:260] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.973026 32754 ts_tablet_manager.cc:1428] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:06.973022 32749 tablet_bootstrap.cc:654] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:06.973779 32749 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: No bootstrap required, opened a new log
I20260810 14:49:06.973834 32749 ts_tablet_manager.cc:1397] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:06.973989 32749 raft_consensus.cc:348] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.974063 32749 raft_consensus.cc:374] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.974102 32749 raft_consensus.cc:729] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.974141 32749 consensus_queue.cc:260] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.974267 32749 ts_tablet_manager.cc:1428] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:06.974920 32760 tablet_bootstrap.cc:492] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: No bootstrap required, opened a new log
I20260810 14:49:06.974973 32760 ts_tablet_manager.cc:1397] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260810 14:49:06.975127 32760 raft_consensus.cc:348] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.975205 32760 raft_consensus.cc:374] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:06.975234 32760 raft_consensus.cc:729] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Initialized, Role: FOLLOWER
I20260810 14:49:06.975283 32760 consensus_queue.cc:260] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:06.975378 32760 ts_tablet_manager.cc:1428] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:07.006543 32765 raft_consensus.cc:482] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:07.006639 32765 raft_consensus.cc:504] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.006960 32765 leader_election.cc:288] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411)
I20260810 14:49:07.010775 32736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.007232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:41181 (local address 127.19.29.193:43267)
0810 14:49:07.007281 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:07.007283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:07.007335 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:49:07.007441 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:07.007442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:07.007456 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:07.007481 (+ 25us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:07.007712 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.008454 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010023 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.010448 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010511 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.010521 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:07.010659 (+ 138us) server_negotiation.cc:299] Negotiation successful
0810 14:49:07.010702 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:49:07.010797 406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.007145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43267 (local address 127.19.29.195:41181)
0810 14:49:07.007275 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:07.007287 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:07.007364 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:07.007545 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:07.007546 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:07.007549 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:07.007628 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.007630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.008572 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.008573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.009918 (+ 1345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.009922 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.010537 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.010598 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.010602 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:07.010647 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:49:07.010722 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260810 14:49:07.011021 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80136da66c53438b912abde13525c15d" candidate_uuid: "c56fc38a06294075bd631a3af07089e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" is_pre_election: true
I20260810 14:49:07.011116 32099 raft_consensus.cc:2454] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56fc38a06294075bd631a3af07089e6 in term 0.
I20260810 14:49:07.011260 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.007370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:47501 (local address 127.19.29.194:44411)
0810 14:49:07.007413 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:07.007415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:07.007523 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:49:07.007566 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:07.007567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:07.007574 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:07.007625 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:07.007793 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.008472 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010104 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.010703 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010772 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.010781 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:07.011149 (+ 368us) server_negotiation.cc:299] Negotiation successful
0810 14:49:07.011196 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:49:07.011281 32485 leader_election.cc:302] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, c56fc38a06294075bd631a3af07089e6; no voters:
I20260810 14:49:07.011394 32765 raft_consensus.cc:2781] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:07.011439 32765 raft_consensus.cc:482] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:07.011467 32765 raft_consensus.cc:3037] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.011545 411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.007307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.19.29.195:47501)
0810 14:49:07.007452 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:07.007462 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:07.007524 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:07.007631 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:07.007632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:07.007634 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:07.007718 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.007720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.008574 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.008575 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.009942 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.009945 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.010831 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.010832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.011014 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.011017 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:07.011350 (+ 333us) client_negotiation.cc:240] Negotiation successful
0810 14:49:07.011395 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":56,"threads_started":1}
I20260810 14:49:07.011803 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80136da66c53438b912abde13525c15d" candidate_uuid: "c56fc38a06294075bd631a3af07089e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc" is_pre_election: true
I20260810 14:49:07.011919 32336 raft_consensus.cc:2454] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c56fc38a06294075bd631a3af07089e6 in term 0.
I20260810 14:49:07.012310 32765 raft_consensus.cc:504] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.012420 32765 leader_election.cc:288] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [CANDIDATE]: Term 1 election: Requested vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411)
I20260810 14:49:07.012588 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80136da66c53438b912abde13525c15d" candidate_uuid: "c56fc38a06294075bd631a3af07089e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
I20260810 14:49:07.012606 32336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80136da66c53438b912abde13525c15d" candidate_uuid: "c56fc38a06294075bd631a3af07089e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b6a20b0a2a34498bab62944942f335bc"
I20260810 14:49:07.012665 32099 raft_consensus.cc:3037] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.012665 32336 raft_consensus.cc:3037] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.013391 32099 raft_consensus.cc:2454] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56fc38a06294075bd631a3af07089e6 in term 1.
I20260810 14:49:07.013391 32336 raft_consensus.cc:2454] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c56fc38a06294075bd631a3af07089e6 in term 1.
I20260810 14:49:07.013557 32485 leader_election.cc:302] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b6a20b0a2a34498bab62944942f335bc, c56fc38a06294075bd631a3af07089e6; no voters:
I20260810 14:49:07.013651 32765 raft_consensus.cc:2781] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:07.013803 32765 raft_consensus.cc:686] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 1 LEADER]: Becoming Leader. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Running, Role: LEADER
I20260810 14:49:07.013902 32765 consensus_queue.cc:237] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.014554 31831 catalog_manager.cc:5495] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to c56fc38a06294075bd631a3af07089e6 (127.19.29.195). New cstate: current_term: 1 leader_uuid: "c56fc38a06294075bd631a3af07089e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } health_report { overall_health: HEALTHY } } }
I20260810 14:49:07.021991 32743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.018441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58994 (local address 127.19.29.195:37877)
0810 14:49:07.018483 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:07.018485 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:07.018526 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:49:07.018595 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:07.018596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:07.018616 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:07.018692 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:07.018779 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.019492 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.020975 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.021266 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.021357 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.021633 (+ 276us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:07.021756 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:07.021823 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:07.021899 (+ 76us) server_negotiation.cc:299] Negotiation successful
0810 14:49:07.021923 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:07.024204 32336 raft_consensus.cc:1261] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Refusing update from remote peer c56fc38a06294075bd631a3af07089e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:07.024443 32765 consensus_queue.cc:1035] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:07.024557 32099 raft_consensus.cc:1261] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Refusing update from remote peer c56fc38a06294075bd631a3af07089e6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:07.027452 416 consensus_queue.cc:1035] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:07.028921 31831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:07.029002 31831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:07.029548 31831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Sending DeleteTablet for 3 replicas of tablet 80136da66c53438b912abde13525c15d
I20260810 14:49:07.029906 32063 tablet_service.cc:1514] Processing DeleteTablet for tablet 80136da66c53438b912abde13525c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60510
I20260810 14:49:07.030002 32297 tablet_service.cc:1514] Processing DeleteTablet for tablet 80136da66c53438b912abde13525c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43584
I20260810 14:49:07.030100 32577 tablet_service.cc:1514] Processing DeleteTablet for tablet 80136da66c53438b912abde13525c15d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:58986
I20260810 14:49:07.030184 323 tablet_replica.cc:330] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: stopping tablet replica
I20260810 14:49:07.030246 323 raft_consensus.cc:2229] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:07.030308 323 raft_consensus.cc:2258] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.030378 315 tablet_replica.cc:330] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: stopping tablet replica
I20260810 14:49:07.030434 315 raft_consensus.cc:2229] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:07.030480 315 raft_consensus.cc:2258] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.030547 317 tablet_replica.cc:330] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: stopping tablet replica
I20260810 14:49:07.030598 317 raft_consensus.cc:2229] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:07.030687 317 raft_consensus.cc:2258] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.031029 315 ts_tablet_manager.cc:1905] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.031020 31831 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:07.031159 31831 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:07.031183 317 ts_tablet_manager.cc:1905] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.032411 32577 tablet_service.cc:1467] Processing CreateTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda (DEFAULT_TABLE table=test-table [id=f94e923fb8fe4b3f89914e7042bebd13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:07.032516 32577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d768bd97b2a64d7cb4badeab5b02bbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:07.032635 32063 tablet_service.cc:1467] Processing CreateTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda (DEFAULT_TABLE table=test-table [id=f94e923fb8fe4b3f89914e7042bebd13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:07.032656 317 ts_tablet_manager.cc:1918] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:07.032706 317 log.cc:1196] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/80136da66c53438b912abde13525c15d
I20260810 14:49:07.032740 32063 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d768bd97b2a64d7cb4badeab5b02bbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:07.032914 317 ts_tablet_manager.cc:1939] T 80136da66c53438b912abde13525c15d P c56fc38a06294075bd631a3af07089e6: Deleting consensus metadata
I20260810 14:49:07.032907 315 ts_tablet_manager.cc:1918] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:07.032972 315 log.cc:1196] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/80136da66c53438b912abde13525c15d
I20260810 14:49:07.033157 315 ts_tablet_manager.cc:1939] T 80136da66c53438b912abde13525c15d P b6a20b0a2a34498bab62944942f335bc: Deleting consensus metadata
I20260810 14:49:07.033874 32754 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Bootstrap starting.
I20260810 14:49:07.033897 32297 tablet_service.cc:1467] Processing CreateTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda (DEFAULT_TABLE table=test-table [id=f94e923fb8fe4b3f89914e7042bebd13]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:07.033984 32297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d768bd97b2a64d7cb4badeab5b02bbda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:07.034183 32754 tablet_bootstrap.cc:654] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:07.034219 32760 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Bootstrap starting.
I20260810 14:49:07.034602 32760 tablet_bootstrap.cc:654] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:07.034979 31806 catalog_manager.cc:4841] TS b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411): tablet 80136da66c53438b912abde13525c15d (table test-table [id=c84bddd71e134b14b4f30fd47e1e8633]) successfully deleted
I20260810 14:49:07.035068 31806 catalog_manager.cc:4841] TS c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877): tablet 80136da66c53438b912abde13525c15d (table test-table [id=c84bddd71e134b14b4f30fd47e1e8633]) successfully deleted
I20260810 14:49:07.035218 32749 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Bootstrap starting.
I20260810 14:49:07.035310 32760 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: No bootstrap required, opened a new log
I20260810 14:49:07.035349 32760 ts_tablet_manager.cc:1397] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:07.035501 32749 tablet_bootstrap.cc:654] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:07.035480 32760 raft_consensus.cc:348] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.035547 32760 raft_consensus.cc:374] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:07.035567 32760 raft_consensus.cc:729] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c56fc38a06294075bd631a3af07089e6, State: Initialized, Role: FOLLOWER
I20260810 14:49:07.035609 32760 consensus_queue.cc:260] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.035640 323 ts_tablet_manager.cc:1905] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.035686 32760 ts_tablet_manager.cc:1428] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:07.036208 32749 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: No bootstrap required, opened a new log
I20260810 14:49:07.036255 32749 ts_tablet_manager.cc:1397] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:07.036353 32749 raft_consensus.cc:348] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.036415 32749 raft_consensus.cc:374] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:07.036433 32749 raft_consensus.cc:729] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Initialized, Role: FOLLOWER
I20260810 14:49:07.036473 32749 consensus_queue.cc:260] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.036566 32749 ts_tablet_manager.cc:1428] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:07.036980 323 ts_tablet_manager.cc:1918] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:07.037042 323 log.cc:1196] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/80136da66c53438b912abde13525c15d
I20260810 14:49:07.037241 323 ts_tablet_manager.cc:1939] T 80136da66c53438b912abde13525c15d P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting consensus metadata
I20260810 14:49:07.037715 31806 catalog_manager.cc:4841] TS 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267): tablet 80136da66c53438b912abde13525c15d (table test-table [id=c84bddd71e134b14b4f30fd47e1e8633]) successfully deleted
I20260810 14:49:07.037817 32754 tablet_bootstrap.cc:492] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: No bootstrap required, opened a new log
I20260810 14:49:07.037866 32754 ts_tablet_manager.cc:1397] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.001s
I20260810 14:49:07.037969 32754 raft_consensus.cc:348] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.038033 32754 raft_consensus.cc:374] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:07.038053 32754 raft_consensus.cc:729] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38be2a340b1f4f0b98a35c0ef8a8e2a2, State: Initialized, Role: FOLLOWER
I20260810 14:49:07.038100 32754 consensus_queue.cc:260] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.038190 32754 ts_tablet_manager.cc:1428] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:07.238379 367 raft_consensus.cc:482] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:07.238479 367 raft_consensus.cc:504] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.238637 367 leader_election.cc:288] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:07.238880 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d768bd97b2a64d7cb4badeab5b02bbda" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6" is_pre_election: true
I20260810 14:49:07.238874 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d768bd97b2a64d7cb4badeab5b02bbda" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" is_pre_election: true
I20260810 14:49:07.238974 32099 raft_consensus.cc:2454] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 0.
I20260810 14:49:07.238974 32607 raft_consensus.cc:2454] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 0.
I20260810 14:49:07.239138 32226 leader_election.cc:302] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, b6a20b0a2a34498bab62944942f335bc; no voters:
I20260810 14:49:07.239246 367 raft_consensus.cc:2781] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:07.239315 367 raft_consensus.cc:482] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:07.239336 367 raft_consensus.cc:3037] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.240286 367 raft_consensus.cc:504] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.240415 367 leader_election.cc:288] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 election: Requested vote from peers 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267), c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877)
I20260810 14:49:07.240620 32607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d768bd97b2a64d7cb4badeab5b02bbda" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c56fc38a06294075bd631a3af07089e6"
I20260810 14:49:07.240612 32099 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d768bd97b2a64d7cb4badeab5b02bbda" candidate_uuid: "b6a20b0a2a34498bab62944942f335bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2"
I20260810 14:49:07.240692 32607 raft_consensus.cc:3037] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.240693 32099 raft_consensus.cc:3037] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:07.241441 32607 raft_consensus.cc:2454] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 1.
I20260810 14:49:07.241441 32099 raft_consensus.cc:2454] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6a20b0a2a34498bab62944942f335bc in term 1.
I20260810 14:49:07.241643 32226 leader_election.cc:302] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 38be2a340b1f4f0b98a35c0ef8a8e2a2, b6a20b0a2a34498bab62944942f335bc; no voters:
I20260810 14:49:07.241730 367 raft_consensus.cc:2781] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:07.241784 367 raft_consensus.cc:686] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 1 LEADER]: Becoming Leader. State: Replica: b6a20b0a2a34498bab62944942f335bc, State: Running, Role: LEADER
I20260810 14:49:07.241827 367 consensus_queue.cc:237] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } }
I20260810 14:49:07.242414 31831 catalog_manager.cc:5495] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc reported cstate change: term changed from 0 to 1, leader changed from <none> to b6a20b0a2a34498bab62944942f335bc (127.19.29.194). New cstate: current_term: 1 leader_uuid: "b6a20b0a2a34498bab62944942f335bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b6a20b0a2a34498bab62944942f335bc" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 44411 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 } health_report { overall_health: UNKNOWN } } }
I20260810 14:49:07.265558 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.263750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43616 (local address 127.19.29.194:44411)
0810 14:49:07.263789 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:07.263791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:07.263814 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:49:07.263874 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:07.263875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:07.263883 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:07.263917 (+ 34us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:07.263995 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.264453 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.265083 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.265266 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.265308 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.265398 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:07.265421 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:07.265451 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:07.265490 (+ 39us) server_negotiation.cc:299] Negotiation successful
0810 14:49:07.265504 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:49:07.269570 32739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.267632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:40013 (local address 127.19.29.194:44411)
0810 14:49:07.267675 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:07.267676 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:07.267683 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:07.267699 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:07.267700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:07.267706 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:07.267746 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:07.267828 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.268249 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.268981 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.269154 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.269210 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.269337 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:07.269358 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:07.269389 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:07.269443 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 14:49:07.269497 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":24}
I20260810 14:49:07.269577 380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.267501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:44411 (local address 127.19.29.194:40013)
0810 14:49:07.267573 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:07.267584 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:07.267633 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:07.267757 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:07.267758 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:07.267758 (+ 0us) client_negotiation.cc:189] Negotiated authn=TOKEN
0810 14:49:07.267792 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.267793 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.268327 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.268328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.268900 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:07.268908 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:07.269233 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:07.269234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:07.269278 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:07.269285 (+ 7us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0810 14:49:07.269400 (+ 115us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0810 14:49:07.269401 (+ 1us) client_negotiation.cc:769] Sending connection context
0810 14:49:07.269440 (+ 39us) client_negotiation.cc:240] Negotiation successful
0810 14:49:07.269512 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":2}
I20260810 14:49:07.271456 32099 raft_consensus.cc:1261] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Refusing update from remote peer b6a20b0a2a34498bab62944942f335bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:07.271456 32607 raft_consensus.cc:1261] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Refusing update from remote peer b6a20b0a2a34498bab62944942f335bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:07.271809 437 consensus_queue.cc:1035] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "38be2a340b1f4f0b98a35c0ef8a8e2a2" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:07.271934 353 consensus_queue.cc:1035] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c56fc38a06294075bd631a3af07089e6" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:07.282383 31831 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:07.282478 31831 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:07.283036 31831 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fb9d9f795f9941fcb9f4ab4d13a7030e: Sending DeleteTablet for 3 replicas of tablet d768bd97b2a64d7cb4badeab5b02bbda
I20260810 14:49:07.283300 32577 tablet_service.cc:1514] Processing DeleteTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:58986
I20260810 14:49:07.283300 32063 tablet_service.cc:1514] Processing DeleteTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60510
I20260810 14:49:07.283386 317 tablet_replica.cc:330] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: stopping tablet replica
I20260810 14:49:07.283386 323 tablet_replica.cc:330] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: stopping tablet replica
I20260810 14:49:07.283427 317 raft_consensus.cc:2229] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:07.283432 323 raft_consensus.cc:2229] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:07.283458 323 raft_consensus.cc:2258] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.283458 317 raft_consensus.cc:2258] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.283799 32297 tablet_service.cc:1514] Processing DeleteTablet for tablet d768bd97b2a64d7cb4badeab5b02bbda with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:07 UTC) from {username='oryx', principal='oryx/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43584
I20260810 14:49:07.283823 317 ts_tablet_manager.cc:1905] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.284026 323 ts_tablet_manager.cc:1905] T d768bd97b2a64d7cb4badeab5b02bbda P 38be2a340b1f4f0b98a35c0ef8a8e2a2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.284456 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 31945
I20260810 14:49:07.285267 315 tablet_replica.cc:330] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: stopping tablet replica
I20260810 14:49:07.285351 315 raft_consensus.cc:2229] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:49:07.285421 315 raft_consensus.cc:2258] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:07.288244 317 ts_tablet_manager.cc:1918] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:49:07.288302 317 log.cc:1196] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d768bd97b2a64d7cb4badeab5b02bbda
I20260810 14:49:07.288496 317 ts_tablet_manager.cc:1939] T d768bd97b2a64d7cb4badeab5b02bbda P c56fc38a06294075bd631a3af07089e6: Deleting consensus metadata
I20260810 14:49:07.288838 31806 catalog_manager.cc:4841] TS c56fc38a06294075bd631a3af07089e6 (127.19.29.195:37877): tablet d768bd97b2a64d7cb4badeab5b02bbda (table test-table [id=f94e923fb8fe4b3f89914e7042bebd13]) successfully deleted
I20260810 14:49:07.291159 315 ts_tablet_manager.cc:1905] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:07.292848 315 ts_tablet_manager.cc:1918] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260810 14:49:07.292901 315 log.cc:1196] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d768bd97b2a64d7cb4badeab5b02bbda
I20260810 14:49:07.293125 315 ts_tablet_manager.cc:1939] T d768bd97b2a64d7cb4badeab5b02bbda P b6a20b0a2a34498bab62944942f335bc: Deleting consensus metadata
I20260810 14:49:07.293457 31806 catalog_manager.cc:4841] TS b6a20b0a2a34498bab62944942f335bc (127.19.29.194:44411): tablet d768bd97b2a64d7cb4badeab5b02bbda (table test-table [id=f94e923fb8fe4b3f89914e7042bebd13]) successfully deleted
W20260810 14:49:07.298493 31806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:43267 (error 108)
I20260810 14:49:07.298725 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 32188
I20260810 14:49:07.304428 444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:07.302657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43267 (local address 127.0.0.1:60530)
0810 14:49:07.304324 (+ 1667us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:07.304387 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43267: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1643,"thread_start_us":67,"threads_started":1}
W20260810 14:49:07.304527 31806 catalog_manager.cc:4584] TS 38be2a340b1f4f0b98a35c0ef8a8e2a2 (127.19.29.193:43267): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d768bd97b2a64d7cb4badeab5b02bbda: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43267: connect: Connection refused (error 111)
I20260810 14:49:07.313647 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 32445
I20260810 14:49:07.325301 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 31765
2026-08-10T14:49:07Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (3056 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:49:07 dist-test-slave-4tdj krb5kdc[447](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:49:07 dist-test-slave-4tdj krb5kdc[447](info): set up 2 sockets
Aug 10 14:49:07 dist-test-slave-4tdj krb5kdc[447](info): commencing operation
krb5kdc: starting...
W20260810 14:49:08.479743 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:08 dist-test-slave-4tdj krb5kdc[447](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373348, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:49:08.592370 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38277
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:37679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:38277
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:08.671545 475 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:08.671736 475 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:08.671756 475 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:08.672853 475 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:08.672891 475 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:08.672904 475 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:08.672916 475 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:08.672927 475 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:08.674433 475 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:38277
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38277
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.475
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:08.674642 475 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:08.674844 475 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:08.679560 485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:08.679641 480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:08.679560 481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:08.679737 475 server_base.cc:1034] running on GCE node
I20260810 14:49:08.679957 475 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:08.680212 475 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:08.681370 475 hybrid_clock.cc:648] HybridClock initialized: now 1786373348681351 us; error 31 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-10T14:49:08Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1356 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:49:08 dist-test-slave-4tdj krb5kdc[500](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:49:08 dist-test-slave-4tdj krb5kdc[500](info): set up 2 sockets
Aug 10 14:49:08 dist-test-slave-4tdj krb5kdc[500](info): commencing operation
krb5kdc: starting...
W20260810 14:49:09.865041 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:09 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:49:09.990185 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34977
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:34977
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:10.070734 518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.070927 518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.070948 518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.072079 518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:10.072122 518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.072135 518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.072149 518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:10.072173 518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:10.073673 518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:34977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.073909 518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.074112 518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:10.078743 533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.078902 526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.078862 528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.078943 518 server_base.cc:1034] running on GCE node
I20260810 14:49:10.079214 518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.079500 518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.080648 518 hybrid_clock.cc:648] HybridClock initialized: now 1786373350080636 us; error 35 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.086261 518 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:49:10.086777 518 webserver.cc:460] Webserver started at http://127.19.29.254:39965/ using document root <none> and password file <none>
I20260810 14:49:10.086990 518 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.087034 518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.087133 518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:10.088146 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "1c8569c6764446208ec3148ecc7402f7"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "a34838ae8a8ab30717e965409e49c7e3"
server_key_iv: "39bab0a66fd110e2fd8da6ea44045857"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.088449 518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "1c8569c6764446208ec3148ecc7402f7"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "a34838ae8a8ab30717e965409e49c7e3"
server_key_iv: "39bab0a66fd110e2fd8da6ea44045857"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.089824 518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:10.090549 546 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.090698 518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:10.090776 518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "1c8569c6764446208ec3148ecc7402f7"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "a34838ae8a8ab30717e965409e49c7e3"
server_key_iv: "39bab0a66fd110e2fd8da6ea44045857"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.090845 518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.107180 518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.109205 518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.109328 518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.113123 518 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:34977
I20260810 14:49:10.113163 629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:34977 every 8 connection(s)
I20260810 14:49:10.113471 518 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:10.114348 630 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:10.114619 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 518
I20260810 14:49:10.114711 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:10.114883 19575 external_mini_cluster.cc:1428] Setting key 89621284a0a0992d3dc34f6ab463edc9
I20260810 14:49:10.117698 630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Bootstrap starting.
I20260810 14:49:10.118410 630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:10.118685 630 log.cc:824] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:10.119318 630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: No bootstrap required, opened a new log
I20260810 14:49:10.121097 630 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373349, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:10.121232 630 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:10.121265 630 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c8569c6764446208ec3148ecc7402f7, State: Initialized, Role: FOLLOWER
I20260810 14:49:10.121395 630 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.121476 630 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:10.121500 630 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:10.121544 630 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:10.122073 630 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.122170 630 leader_election.cc:302] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c8569c6764446208ec3148ecc7402f7; no voters:
I20260810 14:49:10.122354 630 leader_election.cc:288] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:10.122390 639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:10.122515 639 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 LEADER]: Becoming Leader. State: Replica: 1c8569c6764446208ec3148ecc7402f7, State: Running, Role: LEADER
I20260810 14:49:10.122599 639 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.122625 630 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:10.122957 639 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c8569c6764446208ec3148ecc7402f7. Latest consensus state: current_term: 1 leader_uuid: "1c8569c6764446208ec3148ecc7402f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } } }
I20260810 14:49:10.122964 641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c8569c6764446208ec3148ecc7402f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } } }
I20260810 14:49:10.123047 639 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:10.123055 641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:10.123303 648 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:10.123773 648 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:10.125240 648 catalog_manager.cc:1347] Generated new cluster ID: cd0c7eaf2d5845de850e6e0d88b4eb5e
I20260810 14:49:10.125293 648 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:49:10.126114 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.115346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.19.29.254:34977)
0810 14:49:10.115541 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.115551 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.115586 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:49:10.116045 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.116054 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.116118 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.116269 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.116805 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.118146 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.118938 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.119357 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.119451 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.121744 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:10.121748 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:10.121748 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:10.121758 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:10.124424 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.124906 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.124909 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.124910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.124999 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.125220 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.125222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.125222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.125485 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:10.125583 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:10.125804 (+ 221us) server_negotiation.cc:299] Negotiation successful
0810 14:49:10.125928 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":93,"threads_started":1}
I20260810 14:49:10.130594 648 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:10.131242 648 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:10.141494 648 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Generated new TSK 0
I20260810 14:49:10.141677 648 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:49:10.168526 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:10.250476 677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.250679 677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.250715 677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.251849 677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.251892 677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.251930 677 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:10.253350 677 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.253588 677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.253798 677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:10.258651 696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.258708 693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.258687 692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.258853 677 server_base.cc:1034] running on GCE node
I20260810 14:49:10.259011 677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.259224 677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.260358 677 hybrid_clock.cc:648] HybridClock initialized: now 1786373350260349 us; error 26 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.262883 677 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:49:10.263298 677 webserver.cc:460] Webserver started at http://127.19.29.193:34137/ using document root <none> and password file <none>
I20260810 14:49:10.263490 677 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.263559 677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.263682 677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:10.264698 677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "6d494ba017c241419b6c7f4631e89f24"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "55b050c3b09cf1c2aedbbad577a5357c"
server_key_iv: "fe722abfc6cf1f2861acffa07f24470f"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.265023 677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "6d494ba017c241419b6c7f4631e89f24"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "55b050c3b09cf1c2aedbbad577a5357c"
server_key_iv: "fe722abfc6cf1f2861acffa07f24470f"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.266326 677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:49:10.267066 705 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.267215 677 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:10.267293 677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "6d494ba017c241419b6c7f4631e89f24"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "55b050c3b09cf1c2aedbbad577a5357c"
server_key_iv: "fe722abfc6cf1f2861acffa07f24470f"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.267359 677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.289088 677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.290946 677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.291065 677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.291249 677 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:10.291500 677 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:10.291535 677 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.291559 677 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:10.291570 677 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.297032 677 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:35553
I20260810 14:49:10.297088 885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:35553 every 8 connection(s)
I20260810 14:49:10.297380 677 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:10.303648 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 677
I20260810 14:49:10.303750 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:10.303936 19575 external_mini_cluster.cc:1428] Setting key 7f9a7ae99ab6dbe884f190ff5d8f1f56
I20260810 14:49:10.306128 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.298063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:46817 (local address 127.19.29.254:34977)
0810 14:49:10.298126 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.298128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.298339 (+ 211us) server_negotiation.cc:407] Connection header received
0810 14:49:10.298820 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.298821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.298830 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.298880 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.299788 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.300287 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.301224 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.301423 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.301514 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.303505 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:10.303507 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:10.303507 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:10.303520 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:10.304887 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.305305 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.305306 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.305306 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.305355 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.305591 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.305592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.305592 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.305685 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:10.305731 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:10.306000 (+ 269us) server_negotiation.cc:299] Negotiation successful
0810 14:49:10.306065 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:49:10.306366 889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.298031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:46817)
0810 14:49:10.298205 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.298245 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.298741 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.298938 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.298941 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.299478 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.299674 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.299679 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.300360 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.300361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.301142 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.301144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.301515 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.301516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.301622 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.302046 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.302054 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.303425 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:10.304957 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.304964 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.304966 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.305240 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.305409 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.305409 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.305409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.305540 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.305737 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:10.305741 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:10.305883 (+ 142us) client_negotiation.cc:769] Sending connection context
0810 14:49:10.305980 (+ 97us) client_negotiation.cc:240] Negotiation successful
0810 14:49:10.306129 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":99,"threads_started":1}
I20260810 14:49:10.306782 886 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34977
I20260810 14:49:10.306870 886 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:10.307044 886 heartbeater.cc:511] Master 127.19.29.254:34977 requested a full tablet report, sending...
I20260810 14:49:10.307500 571 ts_manager.cc:194] Registered new tserver with Master: 6d494ba017c241419b6c7f4631e89f24 (127.19.29.193:35553)
I20260810 14:49:10.308104 571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:46817
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:49:10.329413 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:10.409408 903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.409591 903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.409613 903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.410755 903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.410794 903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.410817 903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:10.412223 903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.412421 903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.412624 903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:49:10.417544 903 server_base.cc:1034] running on GCE node
W20260810 14:49:10.417551 915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.417508 911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.417511 912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.417968 903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.418202 903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.419346 903 hybrid_clock.cc:648] HybridClock initialized: now 1786373350419336 us; error 28 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.421669 903 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:49:10.422104 903 webserver.cc:460] Webserver started at http://127.19.29.194:41533/ using document root <none> and password file <none>
I20260810 14:49:10.422353 903 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.422397 903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.422518 903 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:10.423597 903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "5707ec2036784fb0bfaa557ebb5dd05d"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "891b7b27b1f5eb7373e2d6ee6dcd6a7d"
server_key_iv: "9aea45599515dcf59704203d4767f36a"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.423933 903 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "5707ec2036784fb0bfaa557ebb5dd05d"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "891b7b27b1f5eb7373e2d6ee6dcd6a7d"
server_key_iv: "9aea45599515dcf59704203d4767f36a"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.425186 903 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:10.425828 924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.425963 903 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:10.426028 903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "5707ec2036784fb0bfaa557ebb5dd05d"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "891b7b27b1f5eb7373e2d6ee6dcd6a7d"
server_key_iv: "9aea45599515dcf59704203d4767f36a"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.426100 903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.440656 903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.442493 903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.442608 903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.442803 903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:10.443070 903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:10.443112 903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.443132 903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:10.443156 903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.448503 903 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:41001
I20260810 14:49:10.448559 1126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:41001 every 8 connection(s)
I20260810 14:49:10.448827 903 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:49:10.454010 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 903
I20260810 14:49:10.454094 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:10.454254 19575 external_mini_cluster.cc:1428] Setting key a331510d9bdfc15959c8fcc447e74057
I20260810 14:49:10.457333 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.449447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:57885 (local address 127.19.29.254:34977)
0810 14:49:10.449490 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.449492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.449687 (+ 195us) server_negotiation.cc:407] Connection header received
0810 14:49:10.450140 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.450141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.450151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.450198 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.451111 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.451594 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.452496 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.452675 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.452718 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.454754 (+ 2036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:10.454755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:10.454756 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:10.454762 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:10.456122 (+ 1360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.456477 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.456478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.456478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.456532 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.456750 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.456751 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.456751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.456860 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:10.456916 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:10.457163 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 14:49:10.457247 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:49:10.457484 1134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.449423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:57885)
0810 14:49:10.449581 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.449620 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.450065 (+ 445us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.450257 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.450260 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.450846 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.451036 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.451040 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.451658 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.451659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.452438 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.452441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.452727 (+ 286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.452728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.452820 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.453263 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.453272 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.454676 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:10.456197 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.456205 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.456207 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.456410 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.456593 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.456594 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.456595 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.456695 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.456914 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:10.456920 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:10.457048 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 14:49:10.457134 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 14:49:10.457278 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":99,"threads_started":1}
I20260810 14:49:10.457917 1127 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34977
I20260810 14:49:10.458002 1127 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:10.458163 1127 heartbeater.cc:511] Master 127.19.29.254:34977 requested a full tablet report, sending...
I20260810 14:49:10.458532 571 ts_manager.cc:194] Registered new tserver with Master: 5707ec2036784fb0bfaa557ebb5dd05d (127.19.29.194:41001)
I20260810 14:49:10.459022 571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:57885
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:49:10.478636 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:10.558106 1138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.558313 1138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.558336 1138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.559425 1138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.559459 1138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.559484 1138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:10.560846 1138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.561031 1138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.561199 1138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:10.565866 1145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.565878 1144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.566035 1138 server_base.cc:1034] running on GCE node
W20260810 14:49:10.566041 1149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.566366 1138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.566602 1138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.567740 1138 hybrid_clock.cc:648] HybridClock initialized: now 1786373350567729 us; error 30 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.570091 1138 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:49:10.570531 1138 webserver.cc:460] Webserver started at http://127.19.29.195:45765/ using document root <none> and password file <none>
I20260810 14:49:10.570722 1138 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.570760 1138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.570850 1138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:10.571753 1138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "c7248e1f84874fc5884f3d4e6083e981"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "3be566f59e82939f036b7c5d4aa43183"
server_key_iv: "8807b669b8bbb1934fe66566d4fbf3a2"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.572041 1138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "c7248e1f84874fc5884f3d4e6083e981"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "3be566f59e82939f036b7c5d4aa43183"
server_key_iv: "8807b669b8bbb1934fe66566d4fbf3a2"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.573136 1138 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:49:10.573753 1164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.573894 1138 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.573975 1138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "c7248e1f84874fc5884f3d4e6083e981"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "3be566f59e82939f036b7c5d4aa43183"
server_key_iv: "8807b669b8bbb1934fe66566d4fbf3a2"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.574043 1138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.584481 1138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.586144 1138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.586272 1138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.586534 1138 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:10.586817 1138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:10.586851 1138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.586877 1138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:10.586902 1138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.592406 1138 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:35421
I20260810 14:49:10.592443 1373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:35421 every 8 connection(s)
I20260810 14:49:10.592730 1138 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:10.592972 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 1138
I20260810 14:49:10.593113 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:10.593298 19575 external_mini_cluster.cc:1428] Setting key 11cf4cdfb4a8b9b529415677608e1ba9
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:10.601262 633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.593479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:46051 (local address 127.19.29.254:34977)
0810 14:49:10.593550 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.593553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.593779 (+ 226us) server_negotiation.cc:407] Connection header received
0810 14:49:10.594421 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.594422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.594432 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.594495 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.595398 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.595887 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.596850 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.597044 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.597102 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.599105 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:10.599107 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:10.599107 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:10.599114 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:10.600170 (+ 1056us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.600513 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.600514 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.600514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.600559 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:10.600745 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:10.600746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:10.600746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:10.600846 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:10.600892 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:10.601129 (+ 237us) server_negotiation.cc:299] Negotiation successful
0810 14:49:10.601198 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:49:10.601348 1376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.593474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:46051)
0810 14:49:10.593657 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.593713 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.594329 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.594556 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.594559 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.595122 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.595303 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.595308 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.595967 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.595968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.596767 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.596770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.597107 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.597108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.597195 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.597632 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.597639 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.599031 (+ 1392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:10.600238 (+ 1207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.600245 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.600247 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.600448 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.600604 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:10.600604 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:10.600604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:10.600694 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:10.600889 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:10.600891 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:10.600999 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 14:49:10.601074 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 14:49:10.601186 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260810 14:49:10.601778 1374 heartbeater.cc:347] Connected to a master server at 127.19.29.254:34977
I20260810 14:49:10.601866 1374 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:10.602015 1374 heartbeater.cc:511] Master 127.19.29.254:34977 requested a full tablet report, sending...
I20260810 14:49:10.602468 571 ts_manager.cc:194] Registered new tserver with Master: c7248e1f84874fc5884f3d4e6083e981 (127.19.29.195:35421)
I20260810 14:49:10.602813 571 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:46051
I20260810 14:49:10.604838 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
Entry for principal oryx/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab.
WARNING: no policy specified for oryx/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
Entry for principal oryx/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab.
WARNING: no policy specified for oryx/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
Entry for principal oryx/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab.
I20260810 14:49:10.670733 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 677
I20260810 14:49:10.686632 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 903
I20260810 14:49:10.693255 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 1138
I20260810 14:49:10.702521 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 518
I20260810 14:49:10.709933 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34977
--webserver_interface=127.19.29.254
--webserver_port=39965
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:34977
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:10.793011 1388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.793200 1388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.793221 1388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.794579 1388 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:10.794631 1388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.794647 1388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.794661 1388 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:10.794673 1388 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:10.796271 1388 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:34977
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=39965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.796481 1388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.796655 1388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:10.801369 1401 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.801401 1406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.801414 1394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.801505 1388 server_base.cc:1034] running on GCE node
I20260810 14:49:10.801788 1388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.802042 1388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.803182 1388 hybrid_clock.cc:648] HybridClock initialized: now 1786373350803168 us; error 29 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.805550 1388 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:49:10.805948 1388 webserver.cc:460] Webserver started at http://127.19.29.254:39965/ using document root <none> and password file <none>
I20260810 14:49:10.806147 1388 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.806205 1388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.807502 1388 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:10.808138 1417 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.808337 1388 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:10.808426 1388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "1c8569c6764446208ec3148ecc7402f7"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "a34838ae8a8ab30717e965409e49c7e3"
server_key_iv: "39bab0a66fd110e2fd8da6ea44045857"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.808782 1388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.821440 1388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.823318 1388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.823439 1388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.827311 1388 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:34977
I20260810 14:49:10.827354 1509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:34977 every 8 connection(s)
I20260810 14:49:10.827694 1388 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:10.829149 1512 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:49:10.829803 1512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Bootstrap starting.
I20260810 14:49:10.835304 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 1388
I20260810 14:49:10.835587 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:35553
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:34977
--webserver_port=34137
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:49:10.838775 1512 log.cc:824] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:10.840306 1512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:49:10.840560 1512 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Bootstrap complete.
I20260810 14:49:10.842819 1512 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.843039 1512 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c8569c6764446208ec3148ecc7402f7, State: Initialized, Role: FOLLOWER
I20260810 14:49:10.843195 1512 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.843271 1512 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:10.843318 1512 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:10.843364 1512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:49:10.844301 1512 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.844400 1512 leader_election.cc:302] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c8569c6764446208ec3148ecc7402f7; no voters:
I20260810 14:49:10.844558 1512 leader_election.cc:288] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:49:10.844609 1523 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:49:10.844731 1523 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [term 2 LEADER]: Becoming Leader. State: Replica: 1c8569c6764446208ec3148ecc7402f7, State: Running, Role: LEADER
I20260810 14:49:10.844835 1512 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:10.844816 1523 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } }
I20260810 14:49:10.845098 1526 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1c8569c6764446208ec3148ecc7402f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } } }
I20260810 14:49:10.845172 1526 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:10.845324 1528 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c8569c6764446208ec3148ecc7402f7. Latest consensus state: current_term: 2 leader_uuid: "1c8569c6764446208ec3148ecc7402f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c8569c6764446208ec3148ecc7402f7" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34977 } } }
I20260810 14:49:10.845387 1528 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:10.845599 1532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:10.846128 1532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:10.846493 1532 catalog_manager.cc:1259] Loaded cluster ID: cd0c7eaf2d5845de850e6e0d88b4eb5e
I20260810 14:49:10.846537 1532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:49:10.847721 1532 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:10.847882 1532 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1c8569c6764446208ec3148ecc7402f7: Loaded TSK: 0
I20260810 14:49:10.848090 1532 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:49:10.917151 1517 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:10.917344 1517 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:10.917366 1517 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:10.918522 1517 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:10.918562 1517 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:10.918588 1517 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:10.920001 1517 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.193.keytab
--principal=oryx/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:35553
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=34137
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1517
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:10.920209 1517 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:10.920413 1517 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:10.926182 1562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.926230 1558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:10.926241 1559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:10.926463 1517 server_base.cc:1034] running on GCE node
I20260810 14:49:10.926672 1517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:10.926862 1517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:10.928012 1517 hybrid_clock.cc:648] HybridClock initialized: now 1786373350927997 us; error 32 us; skew 500 ppm
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373350, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:10.930508 1517 init.cc:377] Logged in from keytab as oryx/127.19.29.193@KRBTEST.COM (short username oryx)
I20260810 14:49:10.930941 1517 webserver.cc:460] Webserver started at http://127.19.29.193:34137/ using document root <none> and password file <none>
I20260810 14:49:10.931138 1517 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:10.931200 1517 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:10.932581 1517 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:10.933275 1574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.933432 1517 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:49:10.933511 1517 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "6d494ba017c241419b6c7f4631e89f24"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "55b050c3b09cf1c2aedbbad577a5357c"
server_key_iv: "fe722abfc6cf1f2861acffa07f24470f"
server_key_version: "encryptionkey@0"
I20260810 14:49:10.933859 1517 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:10.949584 1517 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:10.951766 1517 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:10.951884 1517 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:10.952118 1517 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:10.952450 1517 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:10.952487 1517 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.952509 1517 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:10.952530 1517 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:10.959029 1517 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:35553
I20260810 14:49:10.959087 1768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:35553 every 8 connection(s)
I20260810 14:49:10.959405 1517 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:10.960881 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 1517
I20260810 14:49:10.961186 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:41001
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:34977
--webserver_port=41533
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:10.969278 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.960132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:41647)
0810 14:49:10.960309 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.960344 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.960898 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.961453 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.961458 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.962006 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.962205 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.962210 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.963638 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.963639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.964869 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.964872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.965688 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.965689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.965832 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.966401 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.966413 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.969072 (+ 2659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
W20260810 14:49:10.969827 1769 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:34977 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.29.254:34977: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
W20260810 14:49:10.969835 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:10.960440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:41647 (local address 127.19.29.254:34977)
0810 14:49:10.960650 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.960659 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.960701 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:49:10.961142 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.961147 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.961188 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.961300 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.962347 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.963527 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.964968 (+ 1441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.965600 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.965720 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.969219 (+ 3499us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:41647: BlockingRecv error: recv got EOF from 127.19.29.193:41647 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":97,"threads_started":1}
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:10.974275 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.970065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:40917)
0810 14:49:10.970107 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.970119 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.970159 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.970324 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.970326 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.970465 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.970529 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.970532 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.971116 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.971117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.971887 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.971890 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.972220 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.972222 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.972289 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.972638 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.972642 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.974234 (+ 1592us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 14:49:10.974491 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:10.970126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:40917 (local address 127.19.29.254:34977)
0810 14:49:10.970153 (+ 27us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.970155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.970163 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:10.970207 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.970208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.970220 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.970269 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.970600 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.971045 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.971978 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.972156 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.972200 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.974430 (+ 2230us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:40917: BlockingRecv error: recv got EOF from 127.19.29.193:40917 (error 108)
Metrics: {"server-negotiator.queue_time_us":11,"thread_start_us":84,"threads_started":1}
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:10 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:10.978410 1773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:10.974536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:38923)
0810 14:49:10.974584 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:10.974593 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:10.974626 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:10.974746 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:10.974747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:10.974845 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:10.974871 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.974872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.975706 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.975707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.976172 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:10.976173 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.976587 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.976588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:10.976629 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.976957 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:10.976961 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:10.978369 (+ 1408us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 14:49:10.978509 1769 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:49:10.978641 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:10.974596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:38923 (local address 127.19.29.254:34977)
0810 14:49:10.974641 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:10.974643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:10.974651 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:10.974672 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:10.974673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:10.974682 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:10.974736 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:10.974925 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.975637 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.976230 (+ 593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:10.976516 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:10.976578 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:10.978457 (+ 1879us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:38923: BlockingRecv error: recv got EOF from 127.19.29.193:38923 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260810 14:49:11.045595 1775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:11.045778 1775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:11.045799 1775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:11.046943 1775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:11.046984 1775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:11.047009 1775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:11.048386 1775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.194.keytab
--principal=oryx/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:41001
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=41533
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:11.048566 1775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:11.048732 1775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:11.053484 1792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:11.053486 1790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:11.053553 1786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:11.053650 1775 server_base.cc:1034] running on GCE node
I20260810 14:49:11.053938 1775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:11.054149 1775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:11.055296 1775 hybrid_clock.cc:648] HybridClock initialized: now 1786373351055280 us; error 35 us; skew 500 ppm
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373351, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:11.057797 1775 init.cc:377] Logged in from keytab as oryx/127.19.29.194@KRBTEST.COM (short username oryx)
I20260810 14:49:11.058212 1775 webserver.cc:460] Webserver started at http://127.19.29.194:41533/ using document root <none> and password file <none>
I20260810 14:49:11.058442 1775 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:11.058504 1775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:11.059775 1775 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:11.060424 1801 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.060653 1775 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:11.060738 1775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "5707ec2036784fb0bfaa557ebb5dd05d"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "891b7b27b1f5eb7373e2d6ee6dcd6a7d"
server_key_iv: "9aea45599515dcf59704203d4767f36a"
server_key_version: "encryptionkey@0"
I20260810 14:49:11.061035 1775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:11.089684 1775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:11.091837 1775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:11.091944 1775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:11.092118 1775 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:11.092397 1775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:11.092429 1775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.092451 1775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:11.092474 1775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.097780 1775 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:41001
I20260810 14:49:11.097856 1995 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:41001 every 8 connection(s)
I20260810 14:49:11.098161 1775 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:49:11.105371 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.098824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:52561 (local address 127.19.29.254:34977)
0810 14:49:11.098873 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.098875 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.099090 (+ 215us) server_negotiation.cc:407] Connection header received
0810 14:49:11.099623 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.099625 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.099643 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.099705 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.100663 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.101162 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.102172 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.102413 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.102480 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.105312 (+ 2832us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:52561: BlockingRecv error: recv got EOF from 127.19.29.194:52561 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:49:11.105397 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.098791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:52561)
0810 14:49:11.098969 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.099005 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.099514 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.099782 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.099787 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.100361 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.100557 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.100562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.101256 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.101258 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.102074 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.102077 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.102497 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.102499 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.102627 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.103027 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.103036 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.105187 (+ 2151us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
W20260810 14:49:11.105621 1996 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:34977 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.29.254:34977: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
I20260810 14:49:11.106973 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 1775
I20260810 14:49:11.107226 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:35421
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:34977
--webserver_port=45765
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36397
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:11.110137 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.105829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:37823)
0810 14:49:11.105872 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.105883 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.105923 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.106055 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.106056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.106175 (+ 119us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.106217 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.106219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.106835 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.106836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.107439 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.107441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.107775 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.107776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.107843 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.108221 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.108226 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.110094 (+ 1868us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:49:11.110246 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.105869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:37823 (local address 127.19.29.254:34977)
0810 14:49:11.105925 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.105926 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.105935 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:11.105982 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.105983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.105993 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.106051 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.106285 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.106760 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.107521 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.107705 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.107758 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.110194 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:37823: BlockingRecv error: recv got EOF from 127.19.29.194:37823 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:11.114813 2000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.110558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:46589)
0810 14:49:11.110668 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.110677 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.110717 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.110832 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.110833 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.110969 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.110995 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.110996 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.111809 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.111810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.112322 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.112324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.112745 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.112745 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.112781 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.113139 (+ 358us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.113143 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.114774 (+ 1631us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96}
W20260810 14:49:11.114928 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.110625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:46589 (local address 127.19.29.254:34977)
0810 14:49:11.110670 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.110672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.110716 (+ 44us) server_negotiation.cc:407] Connection header received
0810 14:49:11.110760 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.110761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.110769 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.110828 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.111058 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.111720 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.112392 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.112671 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.112733 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.114871 (+ 2138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:46589: BlockingRecv error: recv got EOF from 127.19.29.194:46589 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
W20260810 14:49:11.115166 1996 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:49:11.188027 2001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:11.188230 2001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:11.188254 2001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:11.189339 2001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:11.189370 2001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:11.189393 2001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:11.190761 2001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36397
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/krb5kdc/oryx_127.19.29.195.keytab
--principal=oryx/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:35421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=45765
--tserver_master_addrs=127.19.29.254:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:11.190984 2001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:11.191188 2001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:11.195834 2008 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:11.195890 2010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:11.195945 2001 server_base.cc:1034] running on GCE node
W20260810 14:49:11.195820 2016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:11.196193 2001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:11.196419 2001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:11.197575 2001 hybrid_clock.cc:648] HybridClock initialized: now 1786373351197563 us; error 29 us; skew 500 ppm
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373351, etypes {rep=17 tkt=17 ses=17}, oryx/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:11.199887 2001 init.cc:377] Logged in from keytab as oryx/127.19.29.195@KRBTEST.COM (short username oryx)
I20260810 14:49:11.200271 2001 webserver.cc:460] Webserver started at http://127.19.29.195:45765/ using document root <none> and password file <none>
I20260810 14:49:11.200454 2001 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:11.200516 2001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:11.201735 2001 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:11.202231 2034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.202378 2001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.202461 2001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "c7248e1f84874fc5884f3d4e6083e981"
format_stamp: "Formatted at 2026-08-10 14:49:10 on dist-test-slave-4tdj"
server_key: "3be566f59e82939f036b7c5d4aa43183"
server_key_iv: "8807b669b8bbb1934fe66566d4fbf3a2"
server_key_version: "encryptionkey@0"
I20260810 14:49:11.202764 2001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:11.223001 2001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:11.224888 2001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:11.225023 2001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:11.225244 2001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:11.225533 2001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:11.225569 2001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.225596 2001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:11.225620 2001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:11.231079 2001 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:35421
I20260810 14:49:11.231134 2236 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:35421 every 8 connection(s)
I20260810 14:49:11.231444 2001 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:11.233309 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 2001
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
W20260810 14:49:11.239872 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.232123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:36463 (local address 127.19.29.254:34977)
0810 14:49:11.232170 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.232172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.232365 (+ 193us) server_negotiation.cc:407] Connection header received
0810 14:49:11.232868 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.232870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.232882 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.232936 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.233907 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.234668 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.235856 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.236193 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.236280 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.239824 (+ 3544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:36463: BlockingRecv error: recv got EOF from 127.19.29.195:36463 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:11.239939 2241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.232102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:36463)
0810 14:49:11.232253 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.232287 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.232759 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.232987 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.232990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.233563 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.233816 (+ 253us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.233823 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.234741 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.234742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.235783 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.235786 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.236280 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.236281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.236377 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.236882 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.236891 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.239747 (+ 2856us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":90,"threads_started":1}
W20260810 14:49:11.240145 2237 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:34977 (0 consecutive failures): Not authorized: Failed to ping master at 127.19.29.254:34977: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
I20260810 14:49:11.241375 1778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.233809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44568 (local address 127.19.29.254:34977)
0810 14:49:11.233862 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.233864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.233871 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:11.233929 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.233930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.233940 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.233994 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.234695 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.235423 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.236457 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.236708 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.236764 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.238149 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:11.238153 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:11.238154 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:11.238166 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:11.239984 (+ 1818us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:11.240379 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:11.240383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:11.240383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:11.240510 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:11.240693 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:11.240693 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:11.240694 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:11.240998 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:11.241095 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:11.241230 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 14:49:11.241315 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:11.244500 2241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.240337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:42045)
0810 14:49:11.240380 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.240389 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.240421 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.240723 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.240723 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.240853 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.240904 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.240906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.241716 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.241717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.242349 (+ 632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.242352 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.242670 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.242671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.242734 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.243049 (+ 315us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.243053 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.244460 (+ 1407us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 14:49:11.244585 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.240577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:42045 (local address 127.19.29.254:34977)
0810 14:49:11.240623 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.240625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.240631 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:49:11.240649 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.240650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.240658 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.240708 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.240964 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.241643 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.242414 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.242608 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.242654 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.244537 (+ 1883us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:42045: BlockingRecv error: recv got EOF from 127.19.29.195:42045 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:11.248281 2241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.244824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:41687)
0810 14:49:11.244865 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.244873 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.244926 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.245044 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.245045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.245157 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.245180 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.245181 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.245769 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.245770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.246245 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.246246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.246567 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.246568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.246615 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.246881 (+ 266us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.246884 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.248226 (+ 1342us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 14:49:11.248347 1774 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.244878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:41687 (local address 127.19.29.254:34977)
0810 14:49:11.244927 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.244928 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.244936 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:11.244972 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.244973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.244981 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.245034 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.245248 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.245708 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.246320 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.246514 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.246563 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.248304 (+ 1741us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:41687: BlockingRecv error: recv got EOF from 127.19.29.195:41687 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260810 14:49:11.248508 2237 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:11 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:11.983286 2243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:11.978889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:43667)
0810 14:49:11.979030 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:11.979042 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:11.979102 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:11.979272 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:11.979273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:11.979437 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:11.979485 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.979487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.980090 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.980091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.980714 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:11.980718 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.981111 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.981113 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:11.981162 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.981562 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:11.981566 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:11.983225 (+ 1659us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":58,"threads_started":1}
W20260810 14:49:11.983417 2244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:11.978954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:43667 (local address 127.19.29.254:34977)
0810 14:49:11.979074 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:11.979075 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:11.979084 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:11.979149 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:11.979150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:11.979167 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:11.979238 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:11.979547 (+ 309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.980037 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.980781 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:11.981032 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:11.981090 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:11.983332 (+ 2242us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:43667: BlockingRecv error: recv got EOF from 127.19.29.193:43667 (error 108)
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":61,"threads_started":1}
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:12.120114 2245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:12.115548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:48909)
0810 14:49:12.115686 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:12.115698 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:12.115769 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:12.115898 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:12.115899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:12.116094 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:12.116143 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.116145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.116824 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.116826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.117370 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.117372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.117723 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.117724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.117780 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.118221 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:12.118227 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:12.120015 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":67,"threads_started":1}
W20260810 14:49:12.120167 2244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:12.115619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:48909 (local address 127.19.29.254:34977)
0810 14:49:12.115684 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:12.115686 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:12.115757 (+ 71us) server_negotiation.cc:407] Connection header received
0810 14:49:12.115825 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:12.115826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:12.115839 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:12.115882 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:12.116219 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.116741 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.117452 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.117661 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.117716 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.120113 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:48909: BlockingRecv error: recv got EOF from 127.19.29.194:48909 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:12.253412 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:12.248846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:56083)
0810 14:49:12.248979 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:12.248989 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:12.249055 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:12.249196 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:12.249197 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:12.249373 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:12.249420 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.249421 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.250050 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.250052 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.250651 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.250654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.250981 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.250982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.251038 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.251537 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:12.251543 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:12.253320 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
W20260810 14:49:12.253475 2244 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:12.248903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:56083 (local address 127.19.29.254:34977)
0810 14:49:12.248949 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:12.248951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:12.249044 (+ 93us) server_negotiation.cc:407] Connection header received
0810 14:49:12.249123 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:12.249124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:12.249138 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:12.249184 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:12.249483 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.249969 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.250733 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.250922 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.250975 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.253422 (+ 2447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:56083: BlockingRecv error: recv got EOF from 127.19.29.195:56083 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:12 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:12.988327 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:12.983729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:43203)
0810 14:49:12.983879 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:12.983890 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:12.983945 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:12.984059 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:12.984060 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:12.984227 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:12.984275 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.984276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.984917 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.984919 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.985475 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:12.985477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.985829 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.985830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:12.985882 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.986381 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:12.986385 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:12.988266 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
W20260810 14:49:12.988446 2248 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:12.983827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:43203 (local address 127.19.29.254:34977)
0810 14:49:12.983932 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:12.983934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:12.983944 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:12.983988 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:12.983989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:12.984000 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:12.984054 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:12.984327 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.984834 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.985580 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:12.985764 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:12.985808 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:12.988371 (+ 2563us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:43203: BlockingRecv error: recv got EOF from 127.19.29.193:43203 (error 108)
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":52,"threads_started":1}
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:13.124974 2249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:13.120601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:50295)
0810 14:49:13.120736 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:13.120746 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:13.120804 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:13.120928 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:13.120929 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:13.121106 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:13.121157 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.121159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.121773 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.121774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.122330 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.122332 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.122637 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.122637 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.122675 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.123122 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:13.123127 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:13.124915 (+ 1788us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":70,"threads_started":1}
W20260810 14:49:13.125102 2248 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:13.120644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:50295 (local address 127.19.29.254:34977)
0810 14:49:13.120692 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:13.120693 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:13.120794 (+ 101us) server_negotiation.cc:407] Connection header received
0810 14:49:13.120847 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:13.120848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:13.120859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:13.120905 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:13.121215 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.121711 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.122389 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.122583 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.122631 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.125033 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:50295: BlockingRecv error: recv got EOF from 127.19.29.194:50295 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:13.258282 2254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:13.253858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:41401)
0810 14:49:13.253997 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:13.254019 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:13.254087 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:13.254216 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:13.254217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:13.254459 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:13.254523 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.254526 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.255179 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.255180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.255711 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.255712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.256060 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.256061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.256124 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.256552 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:13.256557 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:13.258205 (+ 1648us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
W20260810 14:49:13.258379 2248 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:13.253969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:41401 (local address 127.19.29.254:34977)
0810 14:49:13.254028 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:13.254030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:13.254071 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:49:13.254142 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:13.254143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:13.254156 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:13.254202 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:13.254605 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.255103 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.255790 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.255979 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.256033 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.258326 (+ 2293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:41401: BlockingRecv error: recv got EOF from 127.19.29.195:41401 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:13 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:13.993618 2256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:13.988811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:59191)
0810 14:49:13.988965 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:13.988978 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:13.989037 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:13.989180 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:13.989181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:13.989383 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:13.989438 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.989440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.990119 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.990120 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.990834 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:13.990838 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.991167 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.991168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:13.991215 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.991791 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:13.991796 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:13.993529 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
W20260810 14:49:13.993697 2257 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:13.988888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:59191 (local address 127.19.29.254:34977)
0810 14:49:13.989015 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:13.989017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:13.989028 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:49:13.989091 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:13.989092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:13.989103 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:13.989165 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:13.989548 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.990040 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.990903 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:13.991101 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:13.991150 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:13.993639 (+ 2489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:59191: BlockingRecv error: recv got EOF from 127.19.29.193:59191 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:14.129968 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:14.125477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:36075)
0810 14:49:14.125611 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:14.125624 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:14.125704 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:14.125858 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:14.125860 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:14.126056 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:14.126107 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.126110 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.126800 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.126801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.127336 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.127338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.127668 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.127669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.127727 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.128172 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:14.128177 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:14.129878 (+ 1701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":71,"threads_started":1}
W20260810 14:49:14.130043 2257 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:14.125549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:36075 (local address 127.19.29.254:34977)
0810 14:49:14.125601 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:14.125604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:14.125694 (+ 90us) server_negotiation.cc:407] Connection header received
0810 14:49:14.125764 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:14.125765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:14.125775 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:14.125829 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:14.126181 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.126725 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.127411 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.127610 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.127664 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.129981 (+ 2317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:36075: BlockingRecv error: recv got EOF from 127.19.29.194:36075 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:14.263178 2259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:14.258759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:53507)
0810 14:49:14.258916 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:14.258928 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:14.258988 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:14.259118 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:14.259119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:14.259273 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:14.259324 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.259326 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.259916 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.259916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.260430 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.260432 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.260730 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.260731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.260784 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.261277 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:14.261282 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:14.263102 (+ 1820us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":84,"threads_started":1}
W20260810 14:49:14.263347 2257 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:14.258821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:53507 (local address 127.19.29.254:34977)
0810 14:49:14.258878 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:14.258880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:14.258983 (+ 103us) server_negotiation.cc:407] Connection header received
0810 14:49:14.259046 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:14.259047 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:14.259059 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:14.259107 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:14.259373 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.259863 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.260481 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.260650 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.260694 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.263282 (+ 2588us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:53507: BlockingRecv error: recv got EOF from 127.19.29.195:53507 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:14 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:14.998636 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:14.994075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:44751)
0810 14:49:14.994201 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:14.994212 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:14.994262 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:14.994424 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:14.994425 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:14.994595 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:14.994648 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.994649 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.995280 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.995281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.995794 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:14.995795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.996185 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.996187 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:14.996258 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.996756 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:14.996762 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:14.998576 (+ 1814us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
W20260810 14:49:14.998768 2263 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:14.994167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:44751 (local address 127.19.29.254:34977)
0810 14:49:14.994313 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:14.994314 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:14.994321 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:49:14.994342 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:14.994343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:14.994353 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:14.994411 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:14.994717 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.995220 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.995875 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:14.996082 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:14.996145 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:14.998695 (+ 2550us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:44751: BlockingRecv error: recv got EOF from 127.19.29.193:44751 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
Aug 10 14:49:15 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:15 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:15.148613 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:15.130477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:53957)
0810 14:49:15.130634 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:15.130646 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:15.130699 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:15.130817 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:15.130818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:15.130972 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:15.131030 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:15.131031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.131654 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.131655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:15.132221 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:15.132224 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.132557 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.132559 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:15.132613 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:15.146703 (+ 14090us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:15.146708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:15.148552 (+ 1844us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":111,"threads_started":1}
W20260810 14:49:15.148787 2263 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:15.130543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:53957 (local address 127.19.29.254:34977)
0810 14:49:15.130588 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:15.130589 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:15.130685 (+ 96us) server_negotiation.cc:407] Connection header received
0810 14:49:15.130754 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:15.130755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:15.130766 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:15.130804 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:15.131082 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.131563 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.132291 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.132473 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.132519 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:15.148725 (+ 16206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:53957: BlockingRecv error: recv got EOF from 127.19.29.194:53957 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 10 14:49:15 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:15 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:15.268299 2265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:15.263642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:33373)
0810 14:49:15.263788 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:15.263801 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:15.263870 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:15.264050 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:15.264051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:15.264213 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:15.264262 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:15.264264 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.264907 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.264908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:15.265434 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:15.265436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.265724 (+ 288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.265725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:15.265760 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:15.266271 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:15.266276 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:15.268220 (+ 1944us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
W20260810 14:49:15.268361 2263 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:15.263729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:33373 (local address 127.19.29.254:34977)
0810 14:49:15.263792 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:15.263794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:15.263857 (+ 63us) server_negotiation.cc:407] Connection header received
0810 14:49:15.263930 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:15.263931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:15.263945 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:15.264013 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:15.264337 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.264847 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.265490 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:15.265677 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:15.265720 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:15.268309 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:33373: BlockingRecv error: recv got EOF from 127.19.29.195:33373 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:16.003607 2267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:15.999133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:52435)
0810 14:49:15.999263 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:15.999274 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:15.999322 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:15.999514 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:15.999516 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:15.999710 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:15.999764 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:15.999766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.000411 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.000413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.000952 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:16.000954 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.001239 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.001240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.001277 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.001743 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:16.001748 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:16.003543 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
W20260810 14:49:16.003701 2270 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:15.999230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:52435 (local address 127.19.29.254:34977)
0810 14:49:15.999373 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:15.999376 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:15.999385 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:15.999412 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:15.999412 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:15.999426 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:15.999493 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:15.999834 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.000336 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.001010 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.001192 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.001235 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.003637 (+ 2402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:52435: BlockingRecv error: recv got EOF from 127.19.29.193:52435 (error 108)
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":69,"threads_started":1}
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:16.153764 2273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:16.149081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:56795)
0810 14:49:16.149271 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:16.149286 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:16.149359 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:16.149495 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:16.149496 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:16.149673 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:16.149726 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:16.149728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.150382 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.150383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.151005 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:16.151009 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.151363 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.151364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.151408 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.151892 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:16.151896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:16.153703 (+ 1807us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":87,"threads_started":1}
W20260810 14:49:16.153895 2270 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:16.149238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:56795 (local address 127.19.29.254:34977)
0810 14:49:16.149293 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:16.149295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:16.149336 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:49:16.149408 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:16.149409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:16.149419 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:16.149486 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:16.149784 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.150266 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.151093 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.151291 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.151353 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.153819 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:56795: BlockingRecv error: recv got EOF from 127.19.29.194:56795 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:16 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:16.273036 2274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:16.268785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:42057)
0810 14:49:16.268929 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:16.268938 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:16.268993 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:16.269119 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:16.269120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:16.269270 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:16.269319 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:16.269321 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.269921 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.269922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.270490 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:16.270493 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.270858 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.270858 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:16.270894 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.271316 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:16.271320 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:16.272974 (+ 1654us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
W20260810 14:49:16.273202 2270 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:16.268865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:42057 (local address 127.19.29.254:34977)
0810 14:49:16.268923 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:16.268925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:16.268993 (+ 68us) server_negotiation.cc:407] Connection header received
0810 14:49:16.269051 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:16.269051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:16.269063 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:16.269111 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:16.269368 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.269855 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.270600 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:16.270796 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:16.270849 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:16.273096 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:42057: BlockingRecv error: recv got EOF from 127.19.29.195:42057 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:17.008227 2275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:17.004063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:50681)
0810 14:49:17.004188 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:17.004199 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:17.004247 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:17.004377 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:17.004378 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:17.004540 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:17.004590 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.004591 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.005194 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.005195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.005761 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.005764 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.006104 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.006105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.006150 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.006641 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:17.006645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:17.008169 (+ 1524us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":59,"threads_started":1}
W20260810 14:49:17.008325 2276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:17.004132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:50681 (local address 127.19.29.254:34977)
0810 14:49:17.004244 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:17.004246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:17.004256 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:17.004284 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:17.004285 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:17.004296 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:17.004354 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:17.004644 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.005137 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.005830 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.006040 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.006092 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.008258 (+ 2166us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:50681: BlockingRecv error: recv got EOF from 127.19.29.193:50681 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":56,"threads_started":1}
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:17.158721 2277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:17.154260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:45571)
0810 14:49:17.154433 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:17.154444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:17.154500 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:17.154658 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:17.154659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:17.154830 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:17.154886 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.154888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.155527 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.155529 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.156059 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.156061 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.156357 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.156358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.156398 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.156881 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:17.156885 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:17.158659 (+ 1774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":106,"threads_started":1}
W20260810 14:49:17.158861 2276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:17.154364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:45571 (local address 127.19.29.254:34977)
0810 14:49:17.154425 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:17.154427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:17.154487 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:49:17.154579 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:17.154580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:17.154590 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:17.154642 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:17.154937 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.155439 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.156124 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.156302 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.156349 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.158790 (+ 2441us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:45571: BlockingRecv error: recv got EOF from 127.19.29.194:45571 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:17 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:17.278018 2278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:17.273489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:50631)
0810 14:49:17.273648 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:17.273659 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:17.273726 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:17.273852 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:17.273853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:17.274016 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:17.274073 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.274075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.274702 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.274703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.275249 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:17.275251 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.275585 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.275586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:17.275645 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.276081 (+ 436us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:17.276086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:17.277946 (+ 1860us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":88,"threads_started":1}
W20260810 14:49:17.278100 2276 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:17.273573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:50631 (local address 127.19.29.254:34977)
0810 14:49:17.273637 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:17.273639 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:17.273708 (+ 69us) server_negotiation.cc:407] Connection header received
0810 14:49:17.273781 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:17.273782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:17.273794 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:17.273839 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:17.274125 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.274635 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.275310 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:17.275485 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:17.275550 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:17.278042 (+ 2492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:50631: BlockingRecv error: recv got EOF from 127.19.29.195:50631 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:18.012957 2279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:18.008646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:35581)
0810 14:49:18.008771 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:18.008781 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:18.008829 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:18.008959 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:18.008960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:18.009116 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:18.009170 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.009172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.009816 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.009818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.010380 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.010382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.010754 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.010755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.010811 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.011214 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:18.011218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:18.012880 (+ 1662us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
W20260810 14:49:18.013027 2280 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:18.008736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:35581 (local address 127.19.29.254:34977)
0810 14:49:18.008849 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:18.008850 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:18.008858 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:18.008880 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:18.008880 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:18.008890 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:18.008950 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:18.009221 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.009727 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.010458 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.010682 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.010731 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.012954 (+ 2223us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:35581: BlockingRecv error: recv got EOF from 127.19.29.193:35581 (error 108)
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":56,"threads_started":1}
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:18.163738 2281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:18.159251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:48283)
0810 14:49:18.159380 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:18.159390 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:18.159430 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:18.159551 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:18.159552 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:18.159728 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:18.159779 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.159781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.160447 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.160447 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.160971 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.160972 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.161299 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.161300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.161346 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.161839 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:18.161844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:18.163678 (+ 1834us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":61,"threads_started":1}
W20260810 14:49:18.163844 2280 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:18.159355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:48283 (local address 127.19.29.254:34977)
0810 14:49:18.159411 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:18.159412 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:18.159439 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:49:18.159482 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:18.159483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:18.159497 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:18.159539 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:18.159872 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.160383 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.161041 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.161227 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.161280 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.163776 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:48283: BlockingRecv error: recv got EOF from 127.19.29.194:48283 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:18 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:18.283067 2282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:18.278469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:38757)
0810 14:49:18.278649 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:18.278659 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:18.278727 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:18.278890 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:18.278891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:18.279096 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:18.279158 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.279161 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.279881 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.279882 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.280406 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:18.280408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.280752 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.280753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:18.280814 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.281214 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:18.281218 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:18.282997 (+ 1779us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
W20260810 14:49:18.283165 2280 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:18.278541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:38757 (local address 127.19.29.254:34977)
0810 14:49:18.278603 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:18.278606 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:18.278714 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:49:18.278803 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:18.278804 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:18.278819 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:18.278873 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:18.279256 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.279813 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.280470 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:18.280660 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:18.280711 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:18.283104 (+ 2393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:38757: BlockingRecv error: recv got EOF from 127.19.29.195:38757 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:19.017710 2284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:19.013389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:40107)
0810 14:49:19.013538 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:19.013549 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:19.013602 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:19.013719 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:19.013720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:19.013878 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:19.013929 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.013930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.014557 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.014558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.015094 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.015095 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.015408 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.015409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.015454 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.015862 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:19.015866 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:19.017632 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
W20260810 14:49:19.017786 2290 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:19.013497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:40107 (local address 127.19.29.254:34977)
0810 14:49:19.013610 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:19.013612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:19.013620 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:19.013641 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:19.013642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:19.013653 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:19.013707 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:19.013982 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.014493 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.015157 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.015348 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.015397 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.017725 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:40107: BlockingRecv error: recv got EOF from 127.19.29.193:40107 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":47,"threads_started":1}
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:19.171319 2292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:19.164245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:37155)
0810 14:49:19.164472 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:19.164492 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:19.164618 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:19.164899 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:19.164901 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:19.165180 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:19.165259 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.165267 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.166463 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.166464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.167266 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.167269 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.167947 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.167949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.168048 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.168729 (+ 681us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:19.168741 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:19.171238 (+ 2497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":136,"threads_started":1}
W20260810 14:49:19.171476 2290 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:19.164322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:37155 (local address 127.19.29.254:34977)
0810 14:49:19.164400 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:19.164411 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:19.164594 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:49:19.164740 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:19.164742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:19.164756 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:19.164841 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:19.165401 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.166360 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.167398 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.167806 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.167931 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.171360 (+ 3429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:37155: BlockingRecv error: recv got EOF from 127.19.29.194:37155 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:19 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:19.290832 2296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:19.283726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:59307)
0810 14:49:19.283899 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:19.283919 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:19.284033 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:19.284315 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:19.284317 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:19.284576 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:19.284651 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.284654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.285644 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.285644 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.286479 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:19.286481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.287044 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.287045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:19.287097 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.287816 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:19.287821 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:19.290724 (+ 2903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
W20260810 14:49:19.291072 2290 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:19.283811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:59307 (local address 127.19.29.254:34977)
0810 14:49:19.283909 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:19.283918 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:19.284007 (+ 89us) server_negotiation.cc:407] Connection header received
0810 14:49:19.284145 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:19.284146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:19.284168 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:19.284247 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:19.284752 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.285554 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.286614 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:19.286928 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:19.287039 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:19.290913 (+ 3874us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:59307: BlockingRecv error: recv got EOF from 127.19.29.195:59307 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:20.022743 2297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:20.018217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:47213)
0810 14:49:20.018373 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:20.018386 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:20.018443 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:20.018572 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:20.018573 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:20.018743 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:20.018794 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.018796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.019470 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.019471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.020010 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.020012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.020341 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.020342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.020391 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.020806 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:20.020810 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:20.022675 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":89,"threads_started":1}
W20260810 14:49:20.022830 2299 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:20.018321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:47213 (local address 127.19.29.254:34977)
0810 14:49:20.018446 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:20.018448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:20.018475 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:49:20.018498 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:20.018499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:20.018511 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:20.018559 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:20.018853 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.019404 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.020074 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.020276 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.020324 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.022764 (+ 2440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:47213: BlockingRecv error: recv got EOF from 127.19.29.193:47213 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":63,"threads_started":1}
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:20.181070 2302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:20.171808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:58467)
0810 14:49:20.171941 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:20.171952 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:20.172011 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:20.172170 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:20.172174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:20.172345 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:20.172395 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.172397 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.173034 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.173035 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.173582 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.173584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.173862 (+ 278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.173863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.173898 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.179074 (+ 5176us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:20.179079 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:20.180999 (+ 1920us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
W20260810 14:49:20.181198 2299 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:20.171886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:58467 (local address 127.19.29.254:34977)
0810 14:49:20.171963 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:20.171965 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:20.171995 (+ 30us) server_negotiation.cc:407] Connection header received
0810 14:49:20.172064 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:20.172065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:20.172077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:20.172115 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:20.172463 (+ 348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.172962 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.173642 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.173815 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.173856 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.181134 (+ 7278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:58467: BlockingRecv error: recv got EOF from 127.19.29.194:58467 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:20 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:20.295779 2303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:20.291373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:47757)
0810 14:49:20.291506 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:20.291517 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:20.291580 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:20.291705 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:20.291706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:20.291871 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:20.291921 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.291923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.292517 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.292517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.293022 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:20.293023 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.293308 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.293309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:20.293344 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.293803 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:20.293809 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:20.295719 (+ 1910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
W20260810 14:49:20.295950 2299 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:20.291482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:47757 (local address 127.19.29.254:34977)
0810 14:49:20.291539 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:20.291541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:20.291564 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:49:20.291629 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:20.291629 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:20.291642 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:20.291698 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:20.291973 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.292462 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.293075 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:20.293259 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:20.293307 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:20.295899 (+ 2592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:47757: BlockingRecv error: recv got EOF from 127.19.29.195:47757 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:21.028725 2304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:21.023215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:52911)
0810 14:49:21.023360 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:21.023373 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:21.023447 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:21.023610 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:21.023611 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:21.023814 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:21.023881 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.023885 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.024804 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.024805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.025603 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.025607 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.026078 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.026080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.026142 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.026651 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:21.026657 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:21.028663 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
W20260810 14:49:21.028817 2305 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:21.023384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:52911 (local address 127.19.29.254:34977)
0810 14:49:21.023489 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:21.023491 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:21.023499 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:21.023524 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:21.023525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:21.023536 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:21.023596 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:21.023952 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.024728 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.025681 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.026004 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.026069 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.028758 (+ 2689us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:52911: BlockingRecv error: recv got EOF from 127.19.29.193:52911 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":58,"threads_started":1}
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:21.186172 2313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:21.181562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:53701)
0810 14:49:21.181699 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:21.181711 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:21.181783 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:21.181910 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:21.181911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:21.182094 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:21.182143 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.182145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.182841 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.182842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.183365 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.183367 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.183689 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.183690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.183742 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.184151 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:21.184154 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:21.186094 (+ 1940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
W20260810 14:49:21.186286 2305 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:21.181647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:53701 (local address 127.19.29.254:34977)
0810 14:49:21.181709 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:21.181712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:21.181764 (+ 52us) server_negotiation.cc:407] Connection header received
0810 14:49:21.181839 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:21.181840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:21.181852 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:21.181898 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:21.182213 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.182765 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.183439 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.183632 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.183684 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.186213 (+ 2529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:53701: BlockingRecv error: recv got EOF from 127.19.29.194:53701 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:21 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:21.300689 2314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:21.296245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:45019)
0810 14:49:21.296389 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:21.296400 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:21.296456 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:21.296578 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:21.296579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:21.296740 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:21.296788 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.296790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.297436 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.297438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.298016 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:21.298019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.298405 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.298406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:21.298457 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.298906 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:21.298911 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:21.300630 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":59,"threads_started":1}
W20260810 14:49:21.300783 2305 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:21.296357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:45019 (local address 127.19.29.254:34977)
0810 14:49:21.296413 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:21.296414 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:21.296443 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:49:21.296500 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:21.296501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:21.296513 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:21.296564 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:21.296845 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.297345 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.298110 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:21.298332 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:21.298396 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:21.300724 (+ 2328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:45019: BlockingRecv error: recv got EOF from 127.19.29.195:45019 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:22.033519 2317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:22.029162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:55419)
0810 14:49:22.029288 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:22.029300 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:22.029360 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:22.029475 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:22.029476 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:22.029645 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:22.029694 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.029696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.030496 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.030497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.031018 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.031020 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.031311 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.031311 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.031348 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.031742 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:22.031746 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:22.033449 (+ 1703us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
W20260810 14:49:22.033612 2319 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:22.029213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:55419 (local address 127.19.29.254:34977)
0810 14:49:22.029356 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:22.029358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:22.029367 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:22.029396 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:22.029397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:22.029408 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:22.029465 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:22.029761 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.030443 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.031080 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.031262 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.031305 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.033542 (+ 2237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:55419: BlockingRecv error: recv got EOF from 127.19.29.193:55419 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:22.191354 2320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:22.186653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:44259)
0810 14:49:22.186784 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:22.186796 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:22.186851 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:22.187017 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:22.187018 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:22.187198 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:22.187253 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.187255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.187900 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.187901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.188446 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.188449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.188822 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.188823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.188873 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.189338 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:22.189344 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:22.191280 (+ 1936us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
W20260810 14:49:22.191443 2319 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:22.186740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:44259 (local address 127.19.29.254:34977)
0810 14:49:22.186823 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:22.186825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:22.186839 (+ 14us) server_negotiation.cc:407] Connection header received
0810 14:49:22.186940 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:22.186941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:22.186954 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:22.187003 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:22.187321 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.187825 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.188528 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.188748 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.188803 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.191383 (+ 2580us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:44259: BlockingRecv error: recv got EOF from 127.19.29.194:44259 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:22 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:22.305615 2321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:22.301174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:32797)
0810 14:49:22.301326 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:22.301338 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:22.301405 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:22.301538 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:22.301539 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:22.301726 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:22.301770 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.301772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.302451 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.302452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.302980 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:22.302982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.303318 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.303319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:22.303372 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.303814 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:22.303820 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:22.305526 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
W20260810 14:49:22.305680 2319 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:22.301265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:32797 (local address 127.19.29.254:34977)
0810 14:49:22.301328 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:22.301330 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:22.301387 (+ 57us) server_negotiation.cc:407] Connection header received
0810 14:49:22.301455 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:22.301457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:22.301471 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:22.301521 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:22.301842 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.302384 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.303061 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:22.303258 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:22.303311 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:22.305627 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:32797: BlockingRecv error: recv got EOF from 127.19.29.195:32797 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:23.038532 2323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:23.033941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:59905)
0810 14:49:23.034062 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:23.034081 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:23.034134 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:23.034246 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:23.034247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:23.034455 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:23.034506 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.034508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.035274 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.035275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.035842 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.035844 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.036242 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.036242 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.036283 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.036678 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:23.036682 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:23.038431 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
W20260810 14:49:23.038580 2324 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:23.034008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:59905 (local address 127.19.29.254:34977)
0810 14:49:23.034108 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:23.034110 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:23.034122 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:49:23.034175 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:23.034176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:23.034186 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:23.034241 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:23.034579 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.035203 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.035928 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.036178 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.036241 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.038519 (+ 2278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:59905: BlockingRecv error: recv got EOF from 127.19.29.193:59905 (error 108)
Metrics: {"server-negotiator.queue_time_us":77,"thread_start_us":50,"threads_started":1}
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:23.196543 2326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:23.191841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:36551)
0810 14:49:23.192004 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:23.192019 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:23.192091 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:23.192227 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:23.192228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:23.192416 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:23.192463 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.192466 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.193114 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.193115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.193688 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.193690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.194023 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.194024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.194081 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.194558 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:23.194564 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:23.196451 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":70,"threads_started":1}
W20260810 14:49:23.196604 2324 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:23.191936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:36551 (local address 127.19.29.254:34977)
0810 14:49:23.192025 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:23.192027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:23.192087 (+ 60us) server_negotiation.cc:407] Connection header received
0810 14:49:23.192149 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:23.192150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:23.192163 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:23.192214 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:23.192537 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.193042 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.193768 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.193962 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.194022 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.196555 (+ 2533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:36551: BlockingRecv error: recv got EOF from 127.19.29.194:36551 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:23 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:23.310003 2329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:23.306040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:37657)
0810 14:49:23.306168 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:23.306180 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:23.306239 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:23.306370 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:23.306371 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:23.306575 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:23.306623 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.306626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.307213 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.307213 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.307729 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:23.307730 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.307990 (+ 260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.307991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:23.308026 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.308418 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:23.308422 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:23.309946 (+ 1524us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":56,"threads_started":1}
W20260810 14:49:23.310083 2324 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:23.306132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:37657 (local address 127.19.29.254:34977)
0810 14:49:23.306180 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:23.306182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:23.306223 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:49:23.306302 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:23.306303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:23.306316 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:23.306352 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:23.306682 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.307158 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.307780 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:23.307947 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:23.307987 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:23.310031 (+ 2044us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:37657: BlockingRecv error: recv got EOF from 127.19.29.195:37657 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:24.043378 2332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:24.038996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:44955)
0810 14:49:24.039170 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:24.039183 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:24.039242 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:24.039364 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:24.039365 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:24.039531 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:24.039586 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.039587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.040193 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.040194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.040706 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.040707 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.041099 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.041100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.041155 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.041625 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:24.041630 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:24.043318 (+ 1688us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
W20260810 14:49:24.043498 2334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:24.039062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:44955 (local address 127.19.29.254:34977)
0810 14:49:24.039221 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:24.039223 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:24.039231 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:49:24.039285 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:24.039286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:24.039296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:24.039353 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:24.039637 (+ 284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.040137 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.040787 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.040995 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.041059 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.043413 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:44955: BlockingRecv error: recv got EOF from 127.19.29.193:44955 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":101,"threads_started":1}
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:24.201598 2336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:24.197002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:42031)
0810 14:49:24.197138 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:24.197150 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:24.197200 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:24.197399 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:24.197400 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:24.197571 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:24.197618 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.197620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.198250 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.198251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.198870 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.198874 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.199338 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.199339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.199387 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.199786 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:24.199790 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:24.201489 (+ 1699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
W20260810 14:49:24.201646 2334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:24.197121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:42031 (local address 127.19.29.254:34977)
0810 14:49:24.197175 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:24.197176 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:24.197187 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:49:24.197299 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:24.197300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:24.197314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:24.197391 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:24.197692 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.198185 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.198948 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.199265 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.199331 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.201594 (+ 2263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:42031: BlockingRecv error: recv got EOF from 127.19.29.194:42031 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:24 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:24.314891 2337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:24.310458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:33155)
0810 14:49:24.310583 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:24.310595 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:24.310661 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:24.310769 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:24.310770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:24.310937 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:24.311001 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.311002 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.311613 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.311614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.312189 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:24.312192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.312482 (+ 290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.312483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:24.312537 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.313003 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:24.313008 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:24.314824 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
W20260810 14:49:24.314981 2334 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:24.310556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:33155 (local address 127.19.29.254:34977)
0810 14:49:24.310616 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:24.310618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:24.310644 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:49:24.310707 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:24.310708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:24.310720 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:24.310763 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:24.311046 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.311553 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.312250 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:24.312425 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:24.312464 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:24.314917 (+ 2453us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:33155: BlockingRecv error: recv got EOF from 127.19.29.195:33155 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:25.048324 2338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:25.043776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:56397)
0810 14:49:25.043916 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:25.043927 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:25.043980 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:25.044109 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:25.044110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:25.044319 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:25.044370 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.044372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.044984 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.044984 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.045618 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.045621 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.045970 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.045971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.046009 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.046536 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:25.046541 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:25.048233 (+ 1692us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
W20260810 14:49:25.048393 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:25.043847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56397 (local address 127.19.29.254:34977)
0810 14:49:25.043955 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:25.043957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:25.043975 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:49:25.044030 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:25.044031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:25.044041 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:25.044093 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:25.044425 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.044924 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.045703 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.045906 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.045962 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.048330 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:56397: BlockingRecv error: recv got EOF from 127.19.29.193:56397 (error 108)
Metrics: {"server-negotiator.queue_time_us":86,"thread_start_us":52,"threads_started":1}
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:25.209794 2340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:25.202130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:44821)
0810 14:49:25.202264 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:25.202277 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:25.202374 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:25.202494 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:25.202494 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:25.202695 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:25.202757 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.202760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.203615 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.203616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.204164 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.204167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.204552 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.204553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.204603 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.207817 (+ 3214us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:25.207822 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:25.209713 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
W20260810 14:49:25.209882 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:25.202199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:44821 (local address 127.19.29.254:34977)
0810 14:49:25.202305 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:25.202307 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:25.202353 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:49:25.202424 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:25.202425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:25.202435 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:25.202490 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:25.202829 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.203543 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.204255 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.204450 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.204541 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.209829 (+ 5288us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:44821: BlockingRecv error: recv got EOF from 127.19.29.194:44821 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:25 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.195@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:25.319639 2341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:25.315372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.195:44913)
0810 14:49:25.315488 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:25.315499 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:25.315550 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:25.315687 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:25.315688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:25.315854 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:25.315903 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.315905 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.316512 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.316513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.317051 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:25.317053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.317363 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.317363 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:25.317405 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.317869 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:25.317874 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:25.319580 (+ 1706us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":65,"threads_started":1}
W20260810 14:49:25.319736 2339 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:25.315481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:44913 (local address 127.19.29.254:34977)
0810 14:49:25.315534 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:25.315536 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:25.315545 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:25.315617 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:25.315618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:25.315631 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:25.315669 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:25.315957 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.316455 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.317119 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:25.317302 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:25.317353 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:25.319676 (+ 2323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.195:44913: BlockingRecv error: recv got EOF from 127.19.29.195:44913 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 14:49:26 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:26 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.193@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:26.053313 2343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.048888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.193:59431)
0810 14:49:26.049032 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:26.049044 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:26.049105 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:26.049277 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:26.049278 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:26.049493 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:26.049558 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.049562 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.050239 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.050239 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.050811 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.050814 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.051134 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.051135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.051200 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.051622 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:26.051626 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:26.053254 (+ 1628us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":65,"threads_started":1}
W20260810 14:49:26.053404 2344 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:26.048956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:59431 (local address 127.19.29.254:34977)
0810 14:49:26.049084 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.049086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.049095 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:49:26.049173 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.049174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.049187 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.049252 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.049639 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.050173 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.050868 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.051057 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.051101 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.053338 (+ 2237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.193:59431: BlockingRecv error: recv got EOF from 127.19.29.193:59431 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
Aug 10 14:49:26 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
Aug 10 14:49:26 dist-test-slave-4tdj krb5kdc[500](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.19.29.194@KRBTEST.COM for oryx/127.19.29.254@KRBTEST.COM, Server not found in Kerberos database
I20260810 14:49:26.214879 2348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.210412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:34977 (local address 127.19.29.194:44539)
0810 14:49:26.210646 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:26.210657 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:26.210727 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:26.210858 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:26.210859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:26.211034 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:26.211084 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.211086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.211739 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.211740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.212331 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.212334 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.212650 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.212651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.212703 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.213113 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:26.213117 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:26.214794 (+ 1677us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.19.29.254:34977: Server oryx/127.19.29.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":217,"thread_start_us":142,"threads_started":1}
W20260810 14:49:26.214951 2344 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:26.210492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:44539 (local address 127.19.29.254:34977)
0810 14:49:26.210589 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.210591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.210719 (+ 128us) server_negotiation.cc:407] Connection header received
0810 14:49:26.210783 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.210784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.210798 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.210851 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.211173 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.211659 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.212404 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.212592 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.212645 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.214897 (+ 2252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.19.29.194:44539: BlockingRecv error: recv got EOF from 127.19.29.194:44539 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
I20260810 14:49:26.240686 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 1517
I20260810 14:49:26.251502 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 1775
I20260810 14:49:26.261073 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 2001
I20260810 14:49:26.272923 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 1388
2026-08-10T14:49:26Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17586 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-10T14:49:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:26Z Disabled control of system clock
I20260810 14:49:26.303604 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37489
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37489
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260810 14:49:26.383251 2354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:26.383433 2354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:26.383451 2354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:26.384598 2354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:26.384637 2354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:26.384650 2354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:26.384673 2354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:26.384697 2354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:26.386041 2354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37489
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37489
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:26.386258 2354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:26.386538 2354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:26.391489 2365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.391520 2360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.391538 2362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.391693 2354 server_base.cc:1034] running on GCE node
I20260810 14:49:26.392026 2354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:26.392294 2354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:26.393447 2354 hybrid_clock.cc:648] HybridClock initialized: now 1786373366393427 us; error 39 us; skew 500 ppm
I20260810 14:49:26.394682 2354 webserver.cc:460] Webserver started at http://127.19.29.254:38563/ using document root <none> and password file <none>
I20260810 14:49:26.394898 2354 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:26.394948 2354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:26.395076 2354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:26.396102 2354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "37a30db465574f81b96227755688bccf"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "f56c200bc5dc7c689c6fee8e9dd8ff53"
server_key_iv: "0c7969c8c98f07bf2a994f988e72fb4c"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.396436 2354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "37a30db465574f81b96227755688bccf"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "f56c200bc5dc7c689c6fee8e9dd8ff53"
server_key_iv: "0c7969c8c98f07bf2a994f988e72fb4c"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.397646 2354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:49:26.398454 2374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.398648 2354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:26.398743 2354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "37a30db465574f81b96227755688bccf"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "f56c200bc5dc7c689c6fee8e9dd8ff53"
server_key_iv: "0c7969c8c98f07bf2a994f988e72fb4c"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.398811 2354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:26.419129 2354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:26.419445 2354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:26.419584 2354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:26.423318 2354 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:37489
I20260810 14:49:26.423353 2474 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:37489 every 8 connection(s)
I20260810 14:49:26.423688 2354 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:26.424355 2475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:26.427045 2475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: Bootstrap starting.
I20260810 14:49:26.427619 2475 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:26.427824 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 2354
I20260810 14:49:26.427911 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:26.427956 2475 log.cc:824] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:26.428115 19575 external_mini_cluster.cc:1428] Setting key df460a21eff65642b645c4a4b7f2d579
I20260810 14:49:26.428720 2475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: No bootstrap required, opened a new log
I20260810 14:49:26.430585 2475 raft_consensus.cc:348] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } }
I20260810 14:49:26.430756 2475 raft_consensus.cc:374] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:26.430790 2475 raft_consensus.cc:729] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37a30db465574f81b96227755688bccf, State: Initialized, Role: FOLLOWER
I20260810 14:49:26.430909 2475 consensus_queue.cc:260] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } }
I20260810 14:49:26.431308 2475 raft_consensus.cc:388] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:26.431356 2475 raft_consensus.cc:482] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:26.431406 2475 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:26.431941 2475 raft_consensus.cc:504] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } }
I20260810 14:49:26.432040 2475 leader_election.cc:302] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 37a30db465574f81b96227755688bccf; no voters:
I20260810 14:49:26.432199 2475 leader_election.cc:288] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:26.432238 2481 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:26.432475 2475 sys_catalog.cc:564] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:26.432677 2481 raft_consensus.cc:686] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [term 1 LEADER]: Becoming Leader. State: Replica: 37a30db465574f81b96227755688bccf, State: Running, Role: LEADER
I20260810 14:49:26.432796 2481 consensus_queue.cc:237] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } }
I20260810 14:49:26.433307 2484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37a30db465574f81b96227755688bccf. Latest consensus state: current_term: 1 leader_uuid: "37a30db465574f81b96227755688bccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } } }
I20260810 14:49:26.433395 2484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:26.433518 2483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37a30db465574f81b96227755688bccf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37a30db465574f81b96227755688bccf" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37489 } } }
I20260810 14:49:26.433569 2483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:26.433602 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.428639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.19.29.254:37489)
0810 14:49:26.428818 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.428827 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.428858 (+ 31us) server_negotiation.cc:407] Connection header received
0810 14:49:26.429281 (+ 423us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.429287 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.429343 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.429451 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.429647 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.430539 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.431563 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.431951 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.432054 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.432704 (+ 650us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:26.432708 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:26.432708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:26.432913 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:26.432955 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:26.432969 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:26.433284 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:26.433317 (+ 33us) server_negotiation.cc:299] Negotiation successful
0810 14:49:26.433401 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":69,"threads_started":1}
W20260810 14:49:26.434597 2506 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:49:26.434648 2506 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:49:26.434697 2494 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:26.434844 2494 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:26.436196 2494 catalog_manager.cc:1347] Generated new cluster ID: 45893053ac764744852ef1777774a606
I20260810 14:49:26.436251 2494 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:49:26.445144 2494 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:26.445636 2494 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:26.451102 2494 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 37a30db465574f81b96227755688bccf: Generated new TSK 0
I20260810 14:49:26.451242 2494 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:49:26.459247 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--builtin_ntp_servers=127.19.29.212:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260810 14:49:26.540414 2511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:26.540603 2511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:26.540623 2511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:26.541738 2511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:26.541779 2511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:26.541802 2511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:26.543167 2511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:26.543396 2511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:26.543673 2511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:26.548622 2520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.548673 2519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.548619 2526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.548802 2511 server_base.cc:1034] running on GCE node
I20260810 14:49:26.549047 2511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:26.549286 2511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:26.550433 2511 hybrid_clock.cc:648] HybridClock initialized: now 1786373366550421 us; error 26 us; skew 500 ppm
I20260810 14:49:26.551662 2511 webserver.cc:460] Webserver started at http://127.19.29.193:46537/ using document root <none> and password file <none>
I20260810 14:49:26.551894 2511 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:26.551939 2511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:26.552070 2511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:26.553079 2511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "580b3fe8f8ed45e1b32e20b2aa6e6345"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ed4867a3799630e043db596f7f567470"
server_key_iv: "c26b04cdb620e94eb80ac0d9ad9ca385"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.553398 2511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "580b3fe8f8ed45e1b32e20b2aa6e6345"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ed4867a3799630e043db596f7f567470"
server_key_iv: "c26b04cdb620e94eb80ac0d9ad9ca385"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.554700 2511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:26.555390 2536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.555531 2511 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:26.555617 2511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "580b3fe8f8ed45e1b32e20b2aa6e6345"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ed4867a3799630e043db596f7f567470"
server_key_iv: "c26b04cdb620e94eb80ac0d9ad9ca385"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.555675 2511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:26.567380 2511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:26.567612 2511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:26.567725 2511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:26.567894 2511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:26.568176 2511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:26.568208 2511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.568234 2511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:26.568259 2511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.573735 2511 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:34681
I20260810 14:49:26.573792 2760 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:34681 every 8 connection(s)
I20260810 14:49:26.574061 2511 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:26.574442 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 2511
I20260810 14:49:26.574523 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:26.574699 19575 external_mini_cluster.cc:1428] Setting key c7624d8953bc1aca69f17345557c5e5a
I20260810 14:49:26.575605 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--builtin_ntp_servers=127.19.29.212:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 14:49:26.579676 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.574697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:34051 (local address 127.19.29.254:37489)
0810 14:49:26.574756 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.574758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.575031 (+ 273us) server_negotiation.cc:407] Connection header received
0810 14:49:26.575573 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.575574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.575586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.575656 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.576323 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.576973 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.578365 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.578576 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.578655 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.579394 (+ 739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:26.579396 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:26.579396 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:26.579400 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:26.579416 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:26.579420 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:26.579466 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:26.579565 (+ 99us) server_negotiation.cc:299] Negotiation successful
0810 14:49:26.579600 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:49:26.579860 2763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.574696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37489 (local address 127.19.29.193:34051)
0810 14:49:26.574893 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:26.574933 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:26.575473 (+ 540us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:26.575726 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:26.575730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:26.575742 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:26.576236 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.576241 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.577072 (+ 831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.577073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.578251 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.578254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.578676 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.578677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.578808 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.579266 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:26.579266 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:26.579293 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:26.579314 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:26.579472 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:26.579478 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:26.579481 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:26.579563 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 14:49:26.579664 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
I20260810 14:49:26.580281 2761 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37489
I20260810 14:49:26.580364 2761 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:26.580528 2761 heartbeater.cc:511] Master 127.19.29.254:37489 requested a full tablet report, sending...
I20260810 14:49:26.581056 2408 ts_manager.cc:194] Registered new tserver with Master: 580b3fe8f8ed45e1b32e20b2aa6e6345 (127.19.29.193:34681)
I20260810 14:49:26.581923 2408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.193:34051
W20260810 14:49:26.658349 2765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:26.658537 2765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:26.658557 2765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:26.659688 2765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:26.659727 2765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:26.659749 2765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:26.661068 2765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:26.661255 2765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:26.661481 2765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:26.666457 2781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.666502 2765 server_base.cc:1034] running on GCE node
W20260810 14:49:26.666517 2776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.666448 2777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.666893 2765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:26.667120 2765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:26.668262 2765 hybrid_clock.cc:648] HybridClock initialized: now 1786373366668243 us; error 36 us; skew 500 ppm
I20260810 14:49:26.669430 2765 webserver.cc:460] Webserver started at http://127.19.29.194:34783/ using document root <none> and password file <none>
I20260810 14:49:26.669673 2765 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:26.669723 2765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:26.669843 2765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:26.670887 2765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "cbaa6781df764d4a963020719813ab87"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "2e6c0d6137e35434aea9b391ecb80bdf"
server_key_iv: "d248bebe2a685e9ff4a31f28d1844859"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.671204 2765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "cbaa6781df764d4a963020719813ab87"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "2e6c0d6137e35434aea9b391ecb80bdf"
server_key_iv: "d248bebe2a685e9ff4a31f28d1844859"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.672341 2765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:49:26.672961 2795 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.673089 2765 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:26.673170 2765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "cbaa6781df764d4a963020719813ab87"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "2e6c0d6137e35434aea9b391ecb80bdf"
server_key_iv: "d248bebe2a685e9ff4a31f28d1844859"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.673226 2765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:26.700232 2765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:26.700528 2765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:26.700659 2765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:26.700862 2765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:26.701208 2765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:26.701254 2765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.701284 2765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:26.701308 2765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.706930 2765 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34955
I20260810 14:49:26.706977 2997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34955 every 8 connection(s)
I20260810 14:49:26.707289 2765 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:49:26.711463 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 2765
I20260810 14:49:26.711555 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:49:26.711730 19575 external_mini_cluster.cc:1428] Setting key 0446274b1dc97e1e848399bbc69221f5
I20260810 14:49:26.712515 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.707989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:56019 (local address 127.19.29.254:37489)
0810 14:49:26.708049 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.708051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.708270 (+ 219us) server_negotiation.cc:407] Connection header received
0810 14:49:26.708752 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.708753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.708764 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.708815 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.709444 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.709951 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.710949 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.711149 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.711204 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.712270 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:26.712271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:26.712271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:26.712275 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:26.712290 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:26.712294 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:26.712349 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:26.712436 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 14:49:26.712458 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:49:26.712689 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--builtin_ntp_servers=127.19.29.212:38173
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260810 14:49:26.712754 3001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.707970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37489 (local address 127.19.29.194:56019)
0810 14:49:26.708154 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:26.708187 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:26.708653 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:26.708875 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:26.708878 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:26.708887 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:26.709360 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.709363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.710014 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.710015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.710869 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.710872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.711223 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.711225 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.711369 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.711948 (+ 579us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:26.711949 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:26.711985 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:26.712012 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:26.712356 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:26.712361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:26.712365 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:26.712427 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:49:26.712541 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":94,"threads_started":1}
I20260810 14:49:26.713172 2998 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37489
I20260810 14:49:26.713256 2998 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:26.713421 2998 heartbeater.cc:511] Master 127.19.29.254:37489 requested a full tablet report, sending...
I20260810 14:49:26.713843 2408 ts_manager.cc:194] Registered new tserver with Master: cbaa6781df764d4a963020719813ab87 (127.19.29.194:34955)
I20260810 14:49:26.714286 2408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.194:56019
W20260810 14:49:26.793555 3002 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:26.793748 3002 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:26.793779 3002 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:26.794912 3002 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:26.794955 3002 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:26.794991 3002 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:26.796348 3002 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38173
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37489
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3002
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:26.796597 3002 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:26.796891 3002 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:26.801764 3017 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.801783 3014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.801798 3002 server_base.cc:1034] running on GCE node
W20260810 14:49:26.801875 3012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.802166 3002 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:26.802400 3002 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:26.803544 3002 hybrid_clock.cc:648] HybridClock initialized: now 1786373366803540 us; error 25 us; skew 500 ppm
I20260810 14:49:26.804693 3002 webserver.cc:460] Webserver started at http://127.19.29.195:36949/ using document root <none> and password file <none>
I20260810 14:49:26.804903 3002 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:26.804945 3002 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:26.805065 3002 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:26.806048 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "9525e87764f34f29b508a2f0f623ee51"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ba45b7c8a0eb6112ec2940564b98f687"
server_key_iv: "e32caff67717da6396215fcce1c47232"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.806394 3002 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "9525e87764f34f29b508a2f0f623ee51"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ba45b7c8a0eb6112ec2940564b98f687"
server_key_iv: "e32caff67717da6396215fcce1c47232"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.807536 3002 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:26.808188 3023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.808318 3002 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:26.808395 3002 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "9525e87764f34f29b508a2f0f623ee51"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "ba45b7c8a0eb6112ec2940564b98f687"
server_key_iv: "e32caff67717da6396215fcce1c47232"
server_key_version: "encryptionkey@0"
I20260810 14:49:26.808459 3002 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:26.833395 3002 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:26.833679 3002 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:26.833787 3002 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:26.833998 3002 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:26.834311 3002 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:26.834345 3002 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.834367 3002 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:26.834389 3002 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:26.839623 3002 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45491
I20260810 14:49:26.839701 3228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45491 every 8 connection(s)
I20260810 14:49:26.839970 3002 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:26.844779 2479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.840686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:52829 (local address 127.19.29.254:37489)
0810 14:49:26.840735 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.840737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.840945 (+ 208us) server_negotiation.cc:407] Connection header received
0810 14:49:26.841426 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.841427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.841439 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.841514 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.842146 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.842677 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.843608 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.843806 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.843860 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.844565 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:26.844572 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:26.844572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:26.844577 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:26.844591 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:26.844595 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:26.844644 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:26.844698 (+ 54us) server_negotiation.cc:299] Negotiation successful
0810 14:49:26.844721 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 14:49:26.844959 3232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:26.840658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37489 (local address 127.19.29.195:52829)
0810 14:49:26.840842 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:26.840874 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:26.841343 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:26.841566 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:26.841569 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:26.841577 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:26.842052 (+ 475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.842057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.842751 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.842752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.843527 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:26.843530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:26.843872 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:26.843872 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:26.843980 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:26.844438 (+ 458us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:26.844438 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:26.844465 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:26.844487 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:26.844644 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:26.844647 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:26.844649 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:49:26.844692 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:49:26.844766 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260810 14:49:26.845417 3229 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37489
I20260810 14:49:26.845499 3229 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:26.845661 3229 heartbeater.cc:511] Master 127.19.29.254:37489 requested a full tablet report, sending...
I20260810 14:49:26.845994 2408 ts_manager.cc:194] Registered new tserver with Master: 9525e87764f34f29b508a2f0f623ee51 (127.19.29.195:45491)
I20260810 14:49:26.846362 2408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.195:52829
I20260810 14:49:26.848274 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 3002
I20260810 14:49:26.848352 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:26.848537 19575 external_mini_cluster.cc:1428] Setting key 906f9de28ac14b38c6036a7c61b2dcad
I20260810 14:49:26.849267 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:49:26.850967 2479 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:26.850479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42940 (local address 127.19.29.254:37489)
0810 14:49:26.850555 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:26.850557 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:26.850662 (+ 105us) server_negotiation.cc:407] Connection header received
0810 14:49:26.850722 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:26.850723 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:26.850733 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:26.850773 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:26.850905 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42940: BlockingRecv error: recv got EOF from 127.0.0.1:42940 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260810 14:49:26.851038 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 2511
I20260810 14:49:26.863050 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 2765
I20260810 14:49:26.871930 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 3002
I20260810 14:49:26.880081 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 2354
2026-08-10T14:49:26Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (608 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-10T14:49:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:26Z Disabled control of system clock
I20260810 14:49:26.912019 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46079
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:46079
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 14:49:26.991297 3245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:26.991504 3245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:26.991524 3245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:26.992614 3245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:26.992646 3245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:26.992657 3245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:26.992668 3245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:26.992684 3245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:26.993973 3245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:46079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:26.994170 3245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:26.994426 3245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:26.998940 3254 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:26.999064 3257 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.999084 3245 server_base.cc:1034] running on GCE node
W20260810 14:49:26.999001 3262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:26.999408 3245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:26.999727 3245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:27.000877 3245 hybrid_clock.cc:648] HybridClock initialized: now 1786373367000862 us; error 38 us; skew 500 ppm
I20260810 14:49:27.002010 3245 webserver.cc:460] Webserver started at http://127.19.29.254:32983/ using document root <none> and password file <none>
I20260810 14:49:27.002219 3245 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:27.002267 3245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:27.002415 3245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:27.003419 3245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "394671a75b6511b94f6bd234ed10a786"
server_key_iv: "71bb1749b60497a5c181374e264149a7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.003757 3245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "394671a75b6511b94f6bd234ed10a786"
server_key_iv: "71bb1749b60497a5c181374e264149a7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.004968 3245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:49:27.005632 3271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.005798 3245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:27.005883 3245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93"
format_stamp: "Formatted at 2026-08-10 14:49:26 on dist-test-slave-4tdj"
server_key: "394671a75b6511b94f6bd234ed10a786"
server_key_iv: "71bb1749b60497a5c181374e264149a7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.005949 3245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:27.009110 3245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:27.009344 3245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:27.009460 3245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:27.013105 3245 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:46079
I20260810 14:49:27.013137 3377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:46079 every 8 connection(s)
I20260810 14:49:27.013407 3245 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:27.014015 3378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:27.015928 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 3245
I20260810 14:49:27.016039 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:27.016248 19575 external_mini_cluster.cc:1428] Setting key 136c5b8d714f3b936541f81ec73a8dac
I20260810 14:49:27.016945 3378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93: Bootstrap starting.
I20260810 14:49:27.017503 3378 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:27.017794 3378 log.cc:824] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:27.018607 3378 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93: No bootstrap required, opened a new log
I20260810 14:49:27.018788 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.016739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52168 (local address 127.19.29.254:46079)
0810 14:49:27.016925 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:27.016932 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:27.016955 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:49:27.017392 (+ 437us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:27.017399 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:27.017438 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:27.017565 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:27.018237 (+ 672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:27.018242 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:27.018242 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:27.018248 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:27.018319 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:27.018336 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:27.018425 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:27.018533 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:49:27.018590 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260810 14:49:27.020449 3378 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } }
I20260810 14:49:27.020581 3378 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:27.020603 3378 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aa37b3fc7b8416ebcc92cfe2749ef93, State: Initialized, Role: FOLLOWER
I20260810 14:49:27.020700 3378 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } }
I20260810 14:49:27.020771 3378 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:27.020797 3378 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:27.020840 3378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:27.021324 3378 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } }
I20260810 14:49:27.021411 3378 leader_election.cc:302] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4aa37b3fc7b8416ebcc92cfe2749ef93; no voters:
I20260810 14:49:27.021561 3378 leader_election.cc:288] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:27.021719 3391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:27.021782 3378 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:27.021862 3391 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [term 1 LEADER]: Becoming Leader. State: Replica: 4aa37b3fc7b8416ebcc92cfe2749ef93, State: Running, Role: LEADER
I20260810 14:49:27.021997 3391 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } }
I20260810 14:49:27.022383 3391 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4aa37b3fc7b8416ebcc92cfe2749ef93. Latest consensus state: current_term: 1 leader_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } } }
I20260810 14:49:27.022393 3392 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4aa37b3fc7b8416ebcc92cfe2749ef93" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46079 } } }
I20260810 14:49:27.022518 3391 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:27.022562 3392 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:27.023471 3406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:27.023942 3406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:27.026860 3406 catalog_manager.cc:1347] Generated new cluster ID: 37855d6372e442b8a07cab12fffd8733
I20260810 14:49:27.026911 3406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:49:27.038955 3406 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:27.039096 3406 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:27.041735 3406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4aa37b3fc7b8416ebcc92cfe2749ef93: Generated new TSK 0
I20260810 14:49:27.041877 3406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:49:27.050920 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--builtin_ntp_servers=127.19.29.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260810 14:49:27.131233 3427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:27.131426 3427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:27.131455 3427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:27.132570 3427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:27.132606 3427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:27.132638 3427 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:27.133922 3427 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:27.134145 3427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:27.134438 3427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:27.139251 3436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:27.139367 3435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:27.139370 3427 server_base.cc:1034] running on GCE node
W20260810 14:49:27.139258 3438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:27.139729 3427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:27.139946 3427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:27.141093 3427 hybrid_clock.cc:648] HybridClock initialized: now 1786373367141079 us; error 31 us; skew 500 ppm
I20260810 14:49:27.142252 3427 webserver.cc:460] Webserver started at http://127.19.29.193:35573/ using document root <none> and password file <none>
I20260810 14:49:27.142501 3427 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:27.142545 3427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:27.142654 3427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:27.143707 3427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "1d7d3266cc824ca1853ad9194b0aac6d"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "fa84ab2a15e4a73df564d5312b6bd8b1"
server_key_iv: "a35de4134a14aad8a255cb73c57ff02c"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.144023 3427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "1d7d3266cc824ca1853ad9194b0aac6d"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "fa84ab2a15e4a73df564d5312b6bd8b1"
server_key_iv: "a35de4134a14aad8a255cb73c57ff02c"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.145162 3427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:27.145816 3450 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.145967 3427 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:27.146044 3427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "1d7d3266cc824ca1853ad9194b0aac6d"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "fa84ab2a15e4a73df564d5312b6bd8b1"
server_key_iv: "a35de4134a14aad8a255cb73c57ff02c"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.146106 3427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:27.149258 3427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:27.149487 3427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:27.149601 3427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:27.149801 3427 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:27.150079 3427 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:27.150111 3427 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.150137 3427 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:27.150161 3427 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.155639 3427 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:45327
I20260810 14:49:27.155676 3649 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:45327 every 8 connection(s)
I20260810 14:49:27.155957 3427 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:27.156098 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 3427
I20260810 14:49:27.156179 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:27.156374 19575 external_mini_cluster.cc:1428] Setting key d0ae81003fce8d17df4eff1b0141f29b
I20260810 14:49:27.157413 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--builtin_ntp_servers=127.19.29.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 14:49:27.159031 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.156723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48649 (local address 127.19.29.254:46079)
0810 14:49:27.156771 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:27.156773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:27.157176 (+ 403us) server_negotiation.cc:407] Connection header received
0810 14:49:27.157606 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:27.157607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:27.157614 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:27.157665 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:27.158799 (+ 1134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:27.158801 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:27.158801 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:27.158805 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:27.158821 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:27.158825 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:27.158874 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:27.158942 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 14:49:27.158955 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:49:27.159206 3656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.156666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46079 (local address 127.19.29.193:48649)
0810 14:49:27.157028 (+ 362us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:27.157063 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:27.157514 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:27.157731 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:27.157735 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:27.157744 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:27.158663 (+ 919us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:27.158663 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:27.158692 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:27.158719 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:27.158879 (+ 160us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:27.158884 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:27.158887 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:49:27.158954 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 14:49:27.159014 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":87,"threads_started":1}
I20260810 14:49:27.159732 3651 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46079
I20260810 14:49:27.159816 3651 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:27.159950 3651 heartbeater.cc:511] Master 127.19.29.254:46079 requested a full tablet report, sending...
I20260810 14:49:27.160454 3306 ts_manager.cc:194] Registered new tserver with Master: 1d7d3266cc824ca1853ad9194b0aac6d (127.19.29.193:45327)
W20260810 14:49:27.237779 3657 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:27.237962 3657 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:27.237983 3657 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:27.239081 3657 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:27.239113 3657 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:27.239137 3657 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:27.240401 3657 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3657
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:27.240576 3657 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:27.240796 3657 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:27.245823 3672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:27.245862 3669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:27.245836 3675 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:27.245867 3657 server_base.cc:1034] running on GCE node
I20260810 14:49:27.246194 3657 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:27.246430 3657 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:27.247565 3657 hybrid_clock.cc:648] HybridClock initialized: now 1786373367247551 us; error 34 us; skew 500 ppm
I20260810 14:49:27.248798 3657 webserver.cc:460] Webserver started at http://127.19.29.194:44087/ using document root <none> and password file <none>
I20260810 14:49:27.248994 3657 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:27.249037 3657 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:27.249173 3657 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:27.250195 3657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "6167ca26e7da4e54a159e7111bb0dfbc"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "5bd15e2c563c147e29746d1dcfec3cf2"
server_key_iv: "5da737dca0a20e356361f7f10b41a2da"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.250528 3657 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "6167ca26e7da4e54a159e7111bb0dfbc"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "5bd15e2c563c147e29746d1dcfec3cf2"
server_key_iv: "5da737dca0a20e356361f7f10b41a2da"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.251672 3657 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:27.252409 3682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.252558 3657 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:27.252651 3657 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "6167ca26e7da4e54a159e7111bb0dfbc"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "5bd15e2c563c147e29746d1dcfec3cf2"
server_key_iv: "5da737dca0a20e356361f7f10b41a2da"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.252712 3657 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:27.255878 3657 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:27.256108 3657 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:27.256219 3657 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:27.256398 3657 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:27.256677 3657 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:27.256711 3657 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.256735 3657 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:27.256759 3657 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.261983 3657 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:43899
I20260810 14:49:27.262042 3875 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:43899 every 8 connection(s)
I20260810 14:49:27.262342 3657 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:49:27.262781 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 3657
I20260810 14:49:27.262866 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:49:27.263034 19575 external_mini_cluster.cc:1428] Setting key 71fb74067c163e54035e4737e5c616d8
I20260810 14:49:27.263980 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--builtin_ntp_servers=127.19.29.212:37003
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260810 14:49:27.265333 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.262958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:48295 (local address 127.19.29.254:46079)
0810 14:49:27.263023 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:27.263026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:27.263272 (+ 246us) server_negotiation.cc:407] Connection header received
0810 14:49:27.263835 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:27.263836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:27.263841 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:27.263877 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:27.265104 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:27.265105 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:27.265106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:27.265110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:27.265125 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:27.265128 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:27.265177 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:27.265271 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 14:49:27.265282 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:49:27.265538 3878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.262939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46079 (local address 127.19.29.194:48295)
0810 14:49:27.263147 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:27.263189 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:27.263751 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:27.263957 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:27.263960 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:27.263970 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:27.264940 (+ 970us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:27.264941 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:27.264977 (+ 36us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:27.265011 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:27.265189 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:27.265193 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:27.265197 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:27.265279 (+ 82us) client_negotiation.cc:240] Negotiation successful
0810 14:49:27.265338 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260810 14:49:27.266039 3876 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46079
I20260810 14:49:27.266147 3876 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:27.266325 3876 heartbeater.cc:511] Master 127.19.29.254:46079 requested a full tablet report, sending...
I20260810 14:49:27.266678 3306 ts_manager.cc:194] Registered new tserver with Master: 6167ca26e7da4e54a159e7111bb0dfbc (127.19.29.194:43899)
W20260810 14:49:27.345173 3879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:27.345387 3879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:27.345417 3879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:27.346572 3879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:27.346617 3879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:27.346648 3879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:27.347972 3879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37003
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46079
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:27.348215 3879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:27.348516 3879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:27.353366 3886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:27.353456 3892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:27.353526 3879 server_base.cc:1034] running on GCE node
W20260810 14:49:27.353621 3888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:27.353842 3879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:27.354035 3879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:27.355191 3879 hybrid_clock.cc:648] HybridClock initialized: now 1786373367355180 us; error 28 us; skew 500 ppm
I20260810 14:49:27.356392 3879 webserver.cc:460] Webserver started at http://127.19.29.195:39449/ using document root <none> and password file <none>
I20260810 14:49:27.356612 3879 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:27.356655 3879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:27.356775 3879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:27.357808 3879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "695eed5e0acb4dcd8903ad4d3cfabe39"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "c0cc4977ef2af76e176fd4b638c0ccdf"
server_key_iv: "117c9845a665109d502b493c4baaa1d7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.358124 3879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "695eed5e0acb4dcd8903ad4d3cfabe39"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "c0cc4977ef2af76e176fd4b638c0ccdf"
server_key_iv: "117c9845a665109d502b493c4baaa1d7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.359331 3879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:27.359980 3901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.360122 3879 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:27.360198 3879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "695eed5e0acb4dcd8903ad4d3cfabe39"
format_stamp: "Formatted at 2026-08-10 14:49:27 on dist-test-slave-4tdj"
server_key: "c0cc4977ef2af76e176fd4b638c0ccdf"
server_key_iv: "117c9845a665109d502b493c4baaa1d7"
server_key_version: "encryptionkey@0"
I20260810 14:49:27.360261 3879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:27.363445 3879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:27.363660 3879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:27.363767 3879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:27.363942 3879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:27.364218 3879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:27.364248 3879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.364276 3879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:27.364300 3879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:27.369688 3879 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:46613
I20260810 14:49:27.369750 4105 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:46613 every 8 connection(s)
I20260810 14:49:27.370004 3879 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:27.372637 3383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.370659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:43317 (local address 127.19.29.254:46079)
0810 14:49:27.370709 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:27.370712 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:27.370924 (+ 212us) server_negotiation.cc:407] Connection header received
0810 14:49:27.371345 (+ 421us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:27.371346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:27.371353 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:27.371410 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:27.372441 (+ 1031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:27.372442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:27.372442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:49:27.372446 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:27.372461 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:49:27.372465 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:27.372519 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:27.372564 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 14:49:27.372576 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:27.372782 4111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:27.370639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46079 (local address 127.19.29.195:43317)
0810 14:49:27.370817 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:27.370848 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:27.371268 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:27.371476 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:27.371480 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:27.371490 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:27.372312 (+ 822us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:49:27.372313 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:27.372338 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:49:27.372364 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:27.372519 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:27.372521 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:27.372523 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:49:27.372569 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 14:49:27.372620 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260810 14:49:27.373211 4106 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46079
I20260810 14:49:27.373288 4106 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:27.373421 4106 heartbeater.cc:511] Master 127.19.29.254:46079 requested a full tablet report, sending...
I20260810 14:49:27.373734 3306 ts_manager.cc:194] Registered new tserver with Master: 695eed5e0acb4dcd8903ad4d3cfabe39 (127.19.29.195:46613)
I20260810 14:49:27.379652 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 3879
I20260810 14:49:27.379739 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:27.379864 19575 external_mini_cluster.cc:1428] Setting key eae6635dc500dd443d45fe9c12eae6f5
I20260810 14:49:27.380591 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260810 14:49:27.382182 3383 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:49:27.381789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52170 (local address 127.19.29.254:46079)
0810 14:49:27.381829 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:27.381830 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:27.381938 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:49:27.381976 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:27.381977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:27.381981 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:27.382025 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:27.382125 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52170: BlockingRecv error: recv got EOF from 127.0.0.1:52170 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:49:27.382221 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 3427
I20260810 14:49:27.394356 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 3657
I20260810 14:49:27.403486 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 3879
I20260810 14:49:27.414775 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 3245
2026-08-10T14:49:27Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (533 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:49:27 dist-test-slave-4tdj krb5kdc[4124](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:49:27 dist-test-slave-4tdj krb5kdc[4124](info): set up 2 sockets
Aug 10 14:49:27 dist-test-slave-4tdj krb5kdc[4124](info): commencing operation
krb5kdc: starting...
W20260810 14:49:28.589708 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.152s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:28 dist-test-slave-4tdj krb5kdc[4124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:49:28.706401 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45835
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:40823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:28.787307 4150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:28.787539 4150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:28.787575 4150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:28.788757 4150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:49:28.788796 4150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:28.788815 4150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:28.788832 4150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:49:28.788847 4150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:49:28.790349 4150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:28.790585 4150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:28.790776 4150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:28.795459 4160 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:28.795459 4158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:28.795521 4150 server_base.cc:1034] running on GCE node
W20260810 14:49:28.795437 4157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:28.795941 4150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:28.796236 4150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:28.797385 4150 hybrid_clock.cc:648] HybridClock initialized: now 1786373368797367 us; error 38 us; skew 500 ppm
Aug 10 14:49:28 dist-test-slave-4tdj krb5kdc[4124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373368, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:28.799762 4150 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:49:28.800194 4150 webserver.cc:460] Webserver started at http://127.19.29.254:41459/ using document root <none> and password file <none>
I20260810 14:49:28.800423 4150 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:28.800467 4150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:28.800590 4150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:28.801599 4150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "0d3db06e01524f7abec539c42d36b326"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "349c9d0c3697389862941436d87e1d50"
server_key_iv: "55b5aec4ee1c4cc9e6252937e83e37b4"
server_key_version: "encryptionkey@0"
I20260810 14:49:28.801889 4150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "0d3db06e01524f7abec539c42d36b326"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "349c9d0c3697389862941436d87e1d50"
server_key_iv: "55b5aec4ee1c4cc9e6252937e83e37b4"
server_key_version: "encryptionkey@0"
I20260810 14:49:28.803124 4150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:49:28.803800 4174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:28.803949 4150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:49:28.804029 4150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "0d3db06e01524f7abec539c42d36b326"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "349c9d0c3697389862941436d87e1d50"
server_key_iv: "55b5aec4ee1c4cc9e6252937e83e37b4"
server_key_version: "encryptionkey@0"
I20260810 14:49:28.804081 4150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:28.820276 4150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:28.822386 4150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:28.822494 4150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:28.826444 4150 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45835
I20260810 14:49:28.826491 4261 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45835 every 8 connection(s)
I20260810 14:49:28.826799 4150 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:49:28.827785 4262 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:28.830116 4262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: Bootstrap starting.
I20260810 14:49:28.830736 4262 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:28.830979 4262 log.cc:824] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:28.831149 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 4150
I20260810 14:49:28.831249 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:49:28.831426 19575 external_mini_cluster.cc:1428] Setting key 1eb6b7261cbd12b248be3e1cf254377a
I20260810 14:49:28.831750 4262 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: No bootstrap required, opened a new log
I20260810 14:49:28.833896 4262 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } }
I20260810 14:49:28.834090 4262 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:28.834142 4262 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d3db06e01524f7abec539c42d36b326, State: Initialized, Role: FOLLOWER
I20260810 14:49:28.834281 4262 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } }
I20260810 14:49:28.834398 4262 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:49:28.834440 4262 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:49:28.834499 4262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:28.835183 4262 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } }
I20260810 14:49:28.835299 4262 leader_election.cc:302] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d3db06e01524f7abec539c42d36b326; no voters:
I20260810 14:49:28.835451 4262 leader_election.cc:288] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:49:28.835479 4277 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:28.835618 4277 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [term 1 LEADER]: Becoming Leader. State: Replica: 0d3db06e01524f7abec539c42d36b326, State: Running, Role: LEADER
I20260810 14:49:28.835736 4262 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:49:28.835750 4277 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } }
I20260810 14:49:28.836169 4277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d3db06e01524f7abec539c42d36b326. Latest consensus state: current_term: 1 leader_uuid: "0d3db06e01524f7abec539c42d36b326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } } }
I20260810 14:49:28.836244 4283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d3db06e01524f7abec539c42d36b326" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d3db06e01524f7abec539c42d36b326" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45835 } } }
I20260810 14:49:28.836341 4283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:28.836544 4277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326 [sys.catalog]: This master's current role is: LEADER
I20260810 14:49:28.836712 4289 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:49:28.837369 4289 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:49:28.839224 4289 catalog_manager.cc:1347] Generated new cluster ID: bbe3c1f8deb44e7fb3dae317bc22e466
I20260810 14:49:28.839280 4289 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:49:28 dist-test-slave-4tdj krb5kdc[4124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373368, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:28.843251 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:28.831970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60328 (local address 127.19.29.254:45835)
0810 14:49:28.832202 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:28.832213 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:28.832250 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:49:28.833060 (+ 810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:28.833070 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:28.833134 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:28.833283 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:28.833836 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:28.835455 (+ 1619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:28.836566 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:28.837266 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:28.837375 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:28.840180 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:28.840184 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:28.840185 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:28.840198 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:28.841790 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:28.842132 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:28.842135 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:28.842136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:28.842222 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:28.842442 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:28.842443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:28.842443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:28.842672 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:28.842839 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:28.842932 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 14:49:28.843079 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
I20260810 14:49:28.869315 4289 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:49:28.870048 4289 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:49:28.876271 4289 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: Generated new TSK 0
I20260810 14:49:28.876449 4289 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:49:28.903016 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:40823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:28.983450 4310 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:28.983647 4310 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:28.983677 4310 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:28.984817 4310 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:28.984858 4310 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:28.984891 4310 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:49:28.986374 4310 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4310
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:28.986614 4310 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:28.986817 4310 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:28.991516 4322 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:28.991623 4318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:28.991525 4317 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:28.991752 4310 server_base.cc:1034] running on GCE node
I20260810 14:49:28.991966 4310 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:28.992203 4310 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:28.993340 4310 hybrid_clock.cc:648] HybridClock initialized: now 1786373368993329 us; error 31 us; skew 500 ppm
Aug 10 14:49:28 dist-test-slave-4tdj krb5kdc[4124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373368, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:28.995775 4310 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:49:28.996207 4310 webserver.cc:460] Webserver started at http://127.19.29.193:36419/ using document root <none> and password file <none>
I20260810 14:49:28.996412 4310 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:28.996459 4310 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:28.996593 4310 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:28.997589 4310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "d4954906d4644db5934a4c4ad00e041c"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "15d3d7a4c5fb6efd7a28ec2671cc01f6"
server_key_iv: "f6faccac95c41a8b7dbe5963004cfca6"
server_key_version: "encryptionkey@0"
I20260810 14:49:28.997905 4310 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "d4954906d4644db5934a4c4ad00e041c"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "15d3d7a4c5fb6efd7a28ec2671cc01f6"
server_key_iv: "f6faccac95c41a8b7dbe5963004cfca6"
server_key_version: "encryptionkey@0"
I20260810 14:49:28.999326 4310 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:29.000080 4332 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.000244 4310 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.000334 4310 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "d4954906d4644db5934a4c4ad00e041c"
format_stamp: "Formatted at 2026-08-10 14:49:28 on dist-test-slave-4tdj"
server_key: "15d3d7a4c5fb6efd7a28ec2671cc01f6"
server_key_iv: "f6faccac95c41a8b7dbe5963004cfca6"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.000391 4310 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:29.022557 4310 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:29.025092 4310 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:29.025249 4310 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:29.025488 4310 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:29.025835 4310 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:29.025882 4310 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.025910 4310 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:29.025926 4310 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.032183 4310 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41049
I20260810 14:49:29.032238 4529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41049 every 8 connection(s)
I20260810 14:49:29.032521 4310 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:49:29.037943 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 4310
I20260810 14:49:29.038031 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:49:29.038197 19575 external_mini_cluster.cc:1428] Setting key 3ff9fd8eefd144d75002c60c5be62bdc
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[4124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373368, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:29.041478 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.033160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:49071 (local address 127.19.29.254:45835)
0810 14:49:29.033213 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.033215 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.033398 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:49:29.033886 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.033888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.033899 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.033951 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:29.034863 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.035414 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.036360 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.036679 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.036732 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.038835 (+ 2103us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:29.038836 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:29.038837 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:29.038845 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:29.040137 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.040556 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.040557 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.040558 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.040617 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.040839 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.040840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.040840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.040956 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:29.041013 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.041284 (+ 271us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.041382 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:49:29.041604 4536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.033147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45835 (local address 127.19.29.193:49071)
0810 14:49:29.033290 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.033324 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.033795 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.034013 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.034016 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.034590 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:29.034772 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.034777 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.035504 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.035505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.036282 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.036284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.036760 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.036762 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.036870 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.037280 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:29.037288 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:29.038744 (+ 1456us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:29.040234 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.040242 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.040244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.040458 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.040674 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.040675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.040675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.040781 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.041028 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:29.041035 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:29.041163 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.041250 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.041396 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260810 14:49:29.042018 4531 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45835
I20260810 14:49:29.042102 4531 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:29.042265 4531 heartbeater.cc:511] Master 127.19.29.254:45835 requested a full tablet report, sending...
I20260810 14:49:29.042779 4199 ts_manager.cc:194] Registered new tserver with Master: d4954906d4644db5934a4c4ad00e041c (127.19.29.193:41049)
I20260810 14:49:29.043371 4199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:49071
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:49:29.064518 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:40823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:29.144505 4541 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:29.144701 4541 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:29.144721 4541 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:29.145854 4541 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:29.145896 4541 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:29.145922 4541 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:49:29.147409 4541 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4541
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:29.147642 4541 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:29.147851 4541 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:29.152700 4549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:29.152727 4552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:29.152737 4555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:29.152973 4541 server_base.cc:1034] running on GCE node
I20260810 14:49:29.153177 4541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:29.153432 4541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:29.154592 4541 hybrid_clock.cc:648] HybridClock initialized: now 1786373369154577 us; error 36 us; skew 500 ppm
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[4124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373369, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:29.157087 4541 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:49:29.157513 4541 webserver.cc:460] Webserver started at http://127.19.29.194:44255/ using document root <none> and password file <none>
I20260810 14:49:29.157739 4541 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:29.157791 4541 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:29.157928 4541 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:29.159060 4541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "8953a2cdc8e4422bb611ddd11546dcfd"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "c1ec3ec8005fc8d80f1a8a2d49af8591"
server_key_iv: "f677e006df927f6e4434107391cdeeda"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.159409 4541 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "8953a2cdc8e4422bb611ddd11546dcfd"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "c1ec3ec8005fc8d80f1a8a2d49af8591"
server_key_iv: "f677e006df927f6e4434107391cdeeda"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.160738 4541 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:49:29.161520 4570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.161695 4541 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:49:29.161787 4541 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "8953a2cdc8e4422bb611ddd11546dcfd"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "c1ec3ec8005fc8d80f1a8a2d49af8591"
server_key_iv: "f677e006df927f6e4434107391cdeeda"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.161851 4541 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:29.182562 4541 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:29.184434 4541 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:29.184588 4541 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:29.184818 4541 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:29.185163 4541 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:29.185204 4541 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.185249 4541 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:29.185273 4541 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.191488 4541 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:41665
I20260810 14:49:29.191591 4762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:41665 every 8 connection(s)
I20260810 14:49:29.191849 4541 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[4124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373369, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:29.199146 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 4541
I20260810 14:49:29.199256 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:49:29.199465 19575 external_mini_cluster.cc:1428] Setting key ebc614e22a75e2f22530a0076385afbb
I20260810 14:49:29.200949 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.192547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:38773 (local address 127.19.29.254:45835)
0810 14:49:29.192592 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.192594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.192798 (+ 204us) server_negotiation.cc:407] Connection header received
0810 14:49:29.193332 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.193334 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.193349 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.193414 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:29.194378 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.194897 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.195888 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.196103 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.196167 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.198191 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:29.198193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:29.198193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:29.198202 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:29.199639 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.200028 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.200029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.200029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.200090 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.200333 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.200333 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.200334 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.200451 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:29.200507 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.200772 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.200859 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:49:29.201120 4770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.192527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45835 (local address 127.19.29.194:38773)
0810 14:49:29.192682 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.192717 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.193227 (+ 510us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.193486 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.193490 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.194070 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:29.194263 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.194269 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.194996 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.194998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.195796 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.195799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.196180 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.196181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.196311 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.196749 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:29.196758 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:29.198092 (+ 1334us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:29.199720 (+ 1628us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.199729 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.199731 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.199961 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.200154 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.200156 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.200156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.200270 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.200511 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:29.200518 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:29.200649 (+ 131us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.200752 (+ 103us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.200908 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":77,"threads_started":1}
I20260810 14:49:29.201539 4765 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45835
I20260810 14:49:29.201630 4765 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:29.201799 4765 heartbeater.cc:511] Master 127.19.29.254:45835 requested a full tablet report, sending...
I20260810 14:49:29.202206 4199 ts_manager.cc:194] Registered new tserver with Master: 8953a2cdc8e4422bb611ddd11546dcfd (127.19.29.194:41665)
I20260810 14:49:29.202600 4199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:38773
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:49:29.223248 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:40823
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:49:29.305423 4774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:49:29.305635 4774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:49:29.305668 4774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:49:29.306872 4774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:49:29.306921 4774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:49:29.306968 4774 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:49:29.308491 4774 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40823
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45835
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:49:29.308736 4774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:49:29.308954 4774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:49:29.313864 4784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:49:29.313874 4781 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:29.314007 4774 server_base.cc:1034] running on GCE node
W20260810 14:49:29.313874 4786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:49:29.314246 4774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:49:29.314493 4774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:49:29.315630 4774 hybrid_clock.cc:648] HybridClock initialized: now 1786373369315619 us; error 29 us; skew 500 ppm
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[4124](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373369, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:49:29.318022 4774 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:49:29.318495 4774 webserver.cc:460] Webserver started at http://127.19.29.195:35095/ using document root <none> and password file <none>
I20260810 14:49:29.318729 4774 fs_manager.cc:359] Metadata directory not provided
I20260810 14:49:29.318773 4774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:49:29.318895 4774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:49:29.319864 4774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "a35506aaca384d8785c5163d33466beb"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "33781050343914680cfe9074bac9aa26"
server_key_iv: "6a482dddc39fd3c19e7563d17b7530b1"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.320194 4774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "a35506aaca384d8785c5163d33466beb"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "33781050343914680cfe9074bac9aa26"
server_key_iv: "6a482dddc39fd3c19e7563d17b7530b1"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.321403 4774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:49:29.322023 4796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.322162 4774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:49:29.322250 4774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "a35506aaca384d8785c5163d33466beb"
format_stamp: "Formatted at 2026-08-10 14:49:29 on dist-test-slave-4tdj"
server_key: "33781050343914680cfe9074bac9aa26"
server_key_iv: "6a482dddc39fd3c19e7563d17b7530b1"
server_key_version: "encryptionkey@0"
I20260810 14:49:29.322341 4774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:49:29.336675 4774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:49:29.338809 4774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:49:29.338954 4774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:49:29.339176 4774 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:49:29.339498 4774 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:49:29.339538 4774 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.339571 4774 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:49:29.339598 4774 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:49:29.345580 4774 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:34101
I20260810 14:49:29.345649 4998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:34101 every 8 connection(s)
I20260810 14:49:29.345947 4774 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:49:29.347920 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 4774
I20260810 14:49:29.348011 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:49:29.348186 19575 external_mini_cluster.cc:1428] Setting key 19523a7a1e133e4226d4ba5e90e3800c
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[4124](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373369, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:49:29.355125 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.346672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:59207 (local address 127.19.29.254:45835)
0810 14:49:29.346747 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.346750 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.346917 (+ 167us) server_negotiation.cc:407] Connection header received
0810 14:49:29.347427 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.347428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.347439 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.347490 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:29.348564 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.349243 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.350270 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.350533 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.350603 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.352594 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:29.352596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:29.352596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:29.352605 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:29.353844 (+ 1239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.354214 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.354215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.354215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.354271 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.354514 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.354515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.354515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.354643 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:29.354701 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.354953 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.355034 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:49:29.355299 5001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.346630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45835 (local address 127.19.29.195:59207)
0810 14:49:29.346799 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.346837 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.347339 (+ 502us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.347562 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.347565 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.348220 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:49:29.348491 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.348497 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.349333 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.349334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.350175 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.350178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.350639 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.350640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.350751 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.351165 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:49:29.351173 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:49:29.352503 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:49:29.353920 (+ 1417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.353928 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.353930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.354147 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.354355 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:49:29.354356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:49:29.354356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:49:29.354459 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:49:29.354703 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:49:29.354710 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:49:29.354838 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.354924 (+ 86us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.355085 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":92,"threads_started":1}
I20260810 14:49:29.355732 4999 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45835
I20260810 14:49:29.355813 4999 heartbeater.cc:464] Registering TS with master...
I20260810 14:49:29.355952 4999 heartbeater.cc:511] Master 127.19.29.254:45835 requested a full tablet report, sending...
I20260810 14:49:29.356268 4199 ts_manager.cc:194] Registered new tserver with Master: a35506aaca384d8785c5163d33466beb (127.19.29.195:34101)
I20260810 14:49:29.356659 4199 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:59207
I20260810 14:49:29.360142 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:49:29.369612 4276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.362006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60336 (local address 127.19.29.254:45835)
0810 14:49:29.362089 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.362092 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.362215 (+ 123us) server_negotiation.cc:407] Connection header received
0810 14:49:29.362313 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.362315 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.362330 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.362393 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:49:29.362971 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.363482 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.364491 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.364744 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.364811 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.366490 (+ 1679us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:49:29.366492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:49:29.366492 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:49:29.366502 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:49:29.368151 (+ 1649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.368596 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.368597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.368597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.368650 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:49:29.368863 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:49:29.368865 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:49:29.368866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:49:29.369120 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:49:29.369219 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.369418 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.369508 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:49:29.372020 4199 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:49:29.373636 4199 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:49:29.380136 5022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.375943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:34101 (local address 127.0.0.1:55990)
0810 14:49:29.376356 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.376400 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.376465 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.376869 (+ 404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.376873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.376876 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:29.376946 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.376948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.377855 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.377856 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.379006 (+ 1150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.379009 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.379834 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.379835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.379916 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.379930 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.379998 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.380055 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":385,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260810 14:49:29.380158 5020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.376032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55990 (local address 127.19.29.195:34101)
0810 14:49:29.376624 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.376629 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.376639 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:49:29.376677 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.376680 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.376697 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.376768 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:29.377029 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.377766 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.379100 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.379758 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.379824 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.379891 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.380020 (+ 129us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.380068 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":113,"threads_started":1}
I20260810 14:49:29.380615 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.375943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:41665 (local address 127.0.0.1:46016)
0810 14:49:29.376356 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.376401 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.376477 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.377012 (+ 535us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.377012 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.377015 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:29.377057 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.377059 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.378351 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.378353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.379334 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.379338 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.380354 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.380356 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.380423 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.380427 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.380505 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.380547 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":20,"thread_start_us":74,"threads_started":1}
I20260810 14:49:29.380672 5021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.376137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46016 (local address 127.19.29.194:41665)
0810 14:49:29.376324 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.376329 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.376485 (+ 156us) server_negotiation.cc:407] Connection header received
0810 14:49:29.376819 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.376822 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.376839 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.376889 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:29.377123 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.378229 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.379449 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.380181 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.380251 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.380312 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.380538 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.380590 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":108,"threads_started":1}
I20260810 14:49:29.381036 5019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.376155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41049 (local address 127.0.0.1:49456)
0810 14:49:29.376564 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.376573 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.376697 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.376959 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.376960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.376963 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:29.377010 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.377012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.378329 (+ 1317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.378330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.379337 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.379339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.380676 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.380677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.380865 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.380869 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.380916 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.380958 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":397,"mutex_wait_us":55,"thread_start_us":124,"threads_started":1}
I20260810 14:49:29.381099 4871 tablet_service.cc:1467] Processing CreateTablet for tablet deb8675600884ab4bfa6536332c3724a (DEFAULT_TABLE table=test-table [id=1df6112b553c4df38ae46df385de317c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:29.381313 5025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.376363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49456 (local address 127.19.29.193:41049)
0810 14:49:29.376584 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.376589 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.376616 (+ 27us) server_negotiation.cc:407] Connection header received
0810 14:49:29.376858 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.376861 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.376877 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.376949 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:29.377065 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.378177 (+ 1112us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.379411 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.380181 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.380575 (+ 394us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.380649 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.381188 (+ 539us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.381238 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":95,"threads_started":1}
I20260810 14:49:29.381520 4871 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deb8675600884ab4bfa6536332c3724a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:29.381454 4644 tablet_service.cc:1467] Processing CreateTablet for tablet deb8675600884ab4bfa6536332c3724a (DEFAULT_TABLE table=test-table [id=1df6112b553c4df38ae46df385de317c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:29.381781 4644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deb8675600884ab4bfa6536332c3724a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:29.381958 4419 tablet_service.cc:1467] Processing CreateTablet for tablet deb8675600884ab4bfa6536332c3724a (DEFAULT_TABLE table=test-table [id=1df6112b553c4df38ae46df385de317c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:49:29.382284 4419 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet deb8675600884ab4bfa6536332c3724a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:49:29.384472 5028 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Bootstrap starting.
I20260810 14:49:29.384992 5030 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Bootstrap starting.
I20260810 14:49:29.385236 5028 tablet_bootstrap.cc:654] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:29.385473 5034 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: Bootstrap starting.
I20260810 14:49:29.385783 5030 tablet_bootstrap.cc:654] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:29.385803 5028 log.cc:824] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:29.386148 5034 tablet_bootstrap.cc:654] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: Neither blocks nor log segments found. Creating new log.
I20260810 14:49:29.386351 5030 log.cc:824] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:29.386647 5028 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: No bootstrap required, opened a new log
I20260810 14:49:29.386714 5028 ts_tablet_manager.cc:1397] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:29.386852 5034 log.cc:824] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:49:29.387295 5030 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: No bootstrap required, opened a new log
I20260810 14:49:29.387434 5030 ts_tablet_manager.cc:1397] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:49:29.387555 5034 tablet_bootstrap.cc:492] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: No bootstrap required, opened a new log
I20260810 14:49:29.387626 5034 ts_tablet_manager.cc:1397] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:29.388919 5028 raft_consensus.cc:348] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.389000 5034 raft_consensus.cc:348] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.389119 5034 raft_consensus.cc:374] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:29.389122 5028 raft_consensus.cc:374] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:29.389159 5028 raft_consensus.cc:729] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8953a2cdc8e4422bb611ddd11546dcfd, State: Initialized, Role: FOLLOWER
I20260810 14:49:29.389159 5034 raft_consensus.cc:729] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4954906d4644db5934a4c4ad00e041c, State: Initialized, Role: FOLLOWER
I20260810 14:49:29.389300 5034 consensus_queue.cc:260] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.389349 5028 consensus_queue.cc:260] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.389585 5034 ts_tablet_manager.cc:1428] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:49:29.389660 5028 ts_tablet_manager.cc:1428] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:49:29.389737 4531 heartbeater.cc:503] Master 127.19.29.254:45835 was elected leader, sending a full tablet report...
I20260810 14:49:29.389818 4765 heartbeater.cc:503] Master 127.19.29.254:45835 was elected leader, sending a full tablet report...
I20260810 14:49:29.389619 5030 raft_consensus.cc:348] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.390116 5030 raft_consensus.cc:374] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:49:29.390187 5030 raft_consensus.cc:729] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a35506aaca384d8785c5163d33466beb, State: Initialized, Role: FOLLOWER
I20260810 14:49:29.390326 5030 consensus_queue.cc:260] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.390621 5030 ts_tablet_manager.cc:1428] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:49:29.390621 4999 heartbeater.cc:503] Master 127.19.29.254:45835 was elected leader, sending a full tablet report...
I20260810 14:49:29.406888 5041 raft_consensus.cc:482] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:49:29.407019 5041 raft_consensus.cc:504] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.407385 5041 leader_election.cc:288] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a35506aaca384d8785c5163d33466beb (127.19.29.195:34101), 8953a2cdc8e4422bb611ddd11546dcfd (127.19.29.194:41665)
I20260810 14:49:29.410959 4536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.407569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:34101 (local address 127.19.29.193:52449)
0810 14:49:29.407645 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.407657 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.407704 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.407854 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.407856 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.407857 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:29.407927 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.407929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.408708 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.408711 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.409736 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.409740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.410576 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.410578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.410701 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.410707 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.410799 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.410870 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:49:29.411202 5020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.407617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:52449 (local address 127.19.29.195:34101)
0810 14:49:29.407680 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.407682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.407693 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:49:29.407772 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.407773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.407783 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.407835 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:29.408012 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.408584 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.409866 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.410478 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.410550 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.410561 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.410892 (+ 331us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.411101 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:49:29.411578 5021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.407641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48367 (local address 127.19.29.194:41665)
0810 14:49:29.407718 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.407720 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.407975 (+ 255us) server_negotiation.cc:407] Connection header received
0810 14:49:29.408031 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.408032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.408043 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.408080 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:49:29.408314 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.408974 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.410192 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.410757 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.410850 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.410861 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.411424 (+ 563us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.411504 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:49:29.411643 4901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deb8675600884ab4bfa6536332c3724a" candidate_uuid: "d4954906d4644db5934a4c4ad00e041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35506aaca384d8785c5163d33466beb" is_pre_election: true
I20260810 14:49:29.411844 5047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.407574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:41665 (local address 127.19.29.193:48367)
0810 14:49:29.407914 (+ 340us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.407923 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:49:29.407973 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:49:29.408086 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:49:29.408087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:49:29.408089 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:49:29.408157 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.408159 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.409139 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.409141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.410022 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:49:29.410025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.410902 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.410904 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:49:29.411256 (+ 352us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.411266 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 14:49:29.411698 (+ 432us) client_negotiation.cc:240] Negotiation successful
0810 14:49:29.411756 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":324,"mutex_wait_us":148,"thread_start_us":130,"threads_started":1}
I20260810 14:49:29.412062 4901 raft_consensus.cc:2454] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4954906d4644db5934a4c4ad00e041c in term 0.
I20260810 14:49:29.412428 4337 leader_election.cc:302] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a35506aaca384d8785c5163d33466beb, d4954906d4644db5934a4c4ad00e041c; no voters:
I20260810 14:49:29.412388 4677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deb8675600884ab4bfa6536332c3724a" candidate_uuid: "d4954906d4644db5934a4c4ad00e041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" is_pre_election: true
I20260810 14:49:29.412604 5041 raft_consensus.cc:2781] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:49:29.412639 4677 raft_consensus.cc:2454] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4954906d4644db5934a4c4ad00e041c in term 0.
I20260810 14:49:29.412668 5041 raft_consensus.cc:482] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:49:29.412693 5041 raft_consensus.cc:3037] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:29.413504 5041 raft_consensus.cc:504] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.413718 5041 leader_election.cc:288] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [CANDIDATE]: Term 1 election: Requested vote from peers a35506aaca384d8785c5163d33466beb (127.19.29.195:34101), 8953a2cdc8e4422bb611ddd11546dcfd (127.19.29.194:41665)
I20260810 14:49:29.413865 4677 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deb8675600884ab4bfa6536332c3724a" candidate_uuid: "d4954906d4644db5934a4c4ad00e041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8953a2cdc8e4422bb611ddd11546dcfd"
I20260810 14:49:29.413832 4901 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "deb8675600884ab4bfa6536332c3724a" candidate_uuid: "d4954906d4644db5934a4c4ad00e041c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a35506aaca384d8785c5163d33466beb"
I20260810 14:49:29.413925 4677 raft_consensus.cc:3037] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:29.413946 4901 raft_consensus.cc:3037] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:49:29.414983 4901 raft_consensus.cc:2454] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4954906d4644db5934a4c4ad00e041c in term 1.
I20260810 14:49:29.415131 4677 raft_consensus.cc:2454] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4954906d4644db5934a4c4ad00e041c in term 1.
I20260810 14:49:29.415220 4337 leader_election.cc:302] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a35506aaca384d8785c5163d33466beb, d4954906d4644db5934a4c4ad00e041c; no voters:
I20260810 14:49:29.415395 5041 raft_consensus.cc:2781] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:49:29.415589 5041 raft_consensus.cc:686] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [term 1 LEADER]: Becoming Leader. State: Replica: d4954906d4644db5934a4c4ad00e041c, State: Running, Role: LEADER
I20260810 14:49:29.415705 5041 consensus_queue.cc:237] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } }
I20260810 14:49:29.416872 4199 catalog_manager.cc:5495] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c reported cstate change: term changed from 0 to 1, leader changed from <none> to d4954906d4644db5934a4c4ad00e041c (127.19.29.193). New cstate: current_term: 1 leader_uuid: "d4954906d4644db5934a4c4ad00e041c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d4954906d4644db5934a4c4ad00e041c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41049 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 } health_report { overall_health: UNKNOWN } } }
I20260810 14:49:29.426030 5025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.423717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49458 (local address 127.19.29.193:41049)
0810 14:49:29.423762 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:49:29.423764 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:49:29.423790 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:49:29.423878 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:49:29.423879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:49:29.423903 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:49:29.423978 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:49:29.424111 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.424593 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.425362 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:49:29.425544 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:49:29.425592 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:49:29.425705 (+ 113us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:49:29.425804 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:49:29.425859 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:49:29.425939 (+ 80us) server_negotiation.cc:299] Negotiation successful
0810 14:49:29.425955 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:49:29.428021 4901 raft_consensus.cc:1261] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 1 FOLLOWER]: Refusing update from remote peer d4954906d4644db5934a4c4ad00e041c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:29.428349 4677 raft_consensus.cc:1261] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 1 FOLLOWER]: Refusing update from remote peer d4954906d4644db5934a4c4ad00e041c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:49:29.428380 5048 consensus_queue.cc:1035] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a35506aaca384d8785c5163d33466beb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34101 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:29.428598 5048 consensus_queue.cc:1035] T deb8675600884ab4bfa6536332c3724a P d4954906d4644db5934a4c4ad00e041c [LEADER]: Connected to new peer: Peer: permanent_uuid: "8953a2cdc8e4422bb611ddd11546dcfd" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 41665 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:49:29.431206 5052 mvcc.cc:205] Tried to move back new op lower bound from 7316985321174536192 to 7316985321128128512. Current Snapshot: MvccSnapshot[applied={T|T < 7316985321174536192}]
I20260810 14:49:29.431406 5051 mvcc.cc:205] Tried to move back new op lower bound from 7316985321174536192 to 7316985321128128512. Current Snapshot: MvccSnapshot[applied={T|T < 7316985321174536192}]
I20260810 14:49:29.431455 5053 mvcc.cc:205] Tried to move back new op lower bound from 7316985321174536192 to 7316985321128128512. Current Snapshot: MvccSnapshot[applied={T|T < 7316985321174536192}]
I20260810 14:49:29.433689 4198 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:29.433774 4198 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60336:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:49:29.434549 4198 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0d3db06e01524f7abec539c42d36b326: Sending DeleteTablet for 3 replicas of tablet deb8675600884ab4bfa6536332c3724a
I20260810 14:49:29.434904 4644 tablet_service.cc:1514] Processing DeleteTablet for tablet deb8675600884ab4bfa6536332c3724a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:29 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:46016
I20260810 14:49:29.434901 4871 tablet_service.cc:1514] Processing DeleteTablet for tablet deb8675600884ab4bfa6536332c3724a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:49:29 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:55990
I20260810 14:49:29.435166 5067 tablet_replica.cc:330] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: stopping tablet replica
I20260810 14:49:29.435263 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 4310
I20260810 14:49:29.435432 5067 raft_consensus.cc:2229] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:29.435591 5067 raft_consensus.cc:2258] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:29.436132 5067 ts_tablet_manager.cc:1905] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:29.437999 5067 ts_tablet_manager.cc:1918] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:29.438117 5067 log.cc:1196] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/deb8675600884ab4bfa6536332c3724a
I20260810 14:49:29.438452 5067 ts_tablet_manager.cc:1939] T deb8675600884ab4bfa6536332c3724a P 8953a2cdc8e4422bb611ddd11546dcfd: Deleting consensus metadata
I20260810 14:49:29.438835 4178 catalog_manager.cc:4841] TS 8953a2cdc8e4422bb611ddd11546dcfd (127.19.29.194:41665): tablet deb8675600884ab4bfa6536332c3724a (table test-table [id=1df6112b553c4df38ae46df385de317c]) successfully deleted
I20260810 14:49:29.444205 5070 tablet_replica.cc:330] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: stopping tablet replica
I20260810 14:49:29.444402 5070 raft_consensus.cc:2229] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:49:29.444554 5070 raft_consensus.cc:2258] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:49:29.446378 5070 ts_tablet_manager.cc:1905] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:49:29.448133 5070 ts_tablet_manager.cc:1918] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:49:29.448220 5070 log.cc:1196] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/deb8675600884ab4bfa6536332c3724a
I20260810 14:49:29.448493 5070 ts_tablet_manager.cc:1939] T deb8675600884ab4bfa6536332c3724a P a35506aaca384d8785c5163d33466beb: Deleting consensus metadata
I20260810 14:49:29.448989 4181 catalog_manager.cc:4841] TS a35506aaca384d8785c5163d33466beb (127.19.29.195:34101): tablet deb8675600884ab4bfa6536332c3724a (table test-table [id=1df6112b553c4df38ae46df385de317c]) successfully deleted
W20260810 14:49:29.451040 4181 connection.cc:535] client connection to 127.19.29.193:41049 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 14:49:29.451134 4181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:49:29.451248 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 4541
I20260810 14:49:29.459468 5016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:49:29.459311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41049 (local address 127.0.0.1:49468)
0810 14:49:29.459376 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 14:49:29.459430 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:49:29.459625 4181 catalog_manager.cc:4584] TS d4954906d4644db5934a4c4ad00e041c (127.19.29.193:41049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet deb8675600884ab4bfa6536332c3724a: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41049: connect: Connection refused (error 111)
I20260810 14:49:29.463928 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 4774
I20260810 14:49:29.479998 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 4150
2026-08-10T14:49:29Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2068 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[5077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[5077](info): set up 2 sockets
Aug 10 14:49:29 dist-test-slave-4tdj krb5kdc[5077](info): commencing operation
krb5kdc: starting...
W20260810 14:49:30.638967 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:49:30 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373370, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:49:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:49:30Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangeradmin_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangeradmin_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangerlookup_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangerlookup_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
I20260810 14:49:30.798197 19575 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasko2eqSt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/postgres -l logfile start
2026-08-10 14:49:33.026 UTC [5140] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 14:49:33.026 UTC [5140] LOG: listening on IPv4 address "127.19.29.212", port 41945
2026-08-10 14:49:33.029 UTC [5140] LOG: listening on Unix socket "/tmp/.s.PGSQL.41945"
2026-08-10 14:49:33.049 UTC [5147] LOG: database system was shut down at 2026-08-10 14:49:31 UTC
2026-08-10 14:49:33.053 UTC [5140] LOG: database system is ready to accept connections
I20260810 14:49:34.124109 19575 mini_postgres.cc:96] Postgres bound to 41945
2026-08-10 14:49:34.130 UTC [5159] FATAL: database "slave" does not exist
127.19.29.212:41945 - accepting connections
I20260810 14:49:34.131419 19575 mini_ranger.cc:161] Starting Ranger...
I20260810 14:49:34.145836 19575 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 14:49:34.539717 19575 mini_ranger.cc:87] Created ranger Postgres database
I20260810 14:49:34.539784 19575 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin
2026-08-10 14:49:34,836 [I] DB FLAVOR :POSTGRES
2026-08-10 14:49:34,837 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:49:34,837 [I] Checking connection..
2026-08-10 14:49:34,837 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 14:49:35,072 [I] Checking connection passed.
2026-08-10 14:49:35,072 [I] --------- Verifying version history table ---------
2026-08-10 14:49:35,072 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:49:35,313 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:49:35,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:49:35,566 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:49:35,566 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 14:49:35,567 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 14:49:35.816 UTC [5272] WARNING: there is no transaction in progress
2026-08-10 14:49:35,822 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 14:49:35,823 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:49:36,065 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 14:49:36,065 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:49:36,065 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 14:49:36,296 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 14:49:36,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-4tdj.c.gcp-upstream.internal','N') ;"
2026-08-10 14:49:36,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:49:37,047 [I] Table x_portal_user does not exist in database ranger
2026-08-10 14:49:37,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:49:37,290 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 14:49:37,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:49:37,548 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:49:37,806 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 14:49:37,806 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 14:49:38.690 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.706 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.721 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.736 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.750 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.767 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.826 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.832 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.845 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.854 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.863 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.876 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.885 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.891 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.896 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:38.902 UTC [5461] WARNING: there is no transaction in progress
2026-08-10 14:49:39,480 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 14:49:39,480 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 14:49:39,728 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 14:49:39,729 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:49:39,987 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 14:49:39,987 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:49:40,235 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 14:49:40,236 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:49:40,485 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:49:40,725 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-4tdj.c.gcp-upstream.internal';"
2026-08-10 14:49:40,959 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 14:49:40,959 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 14:49:41,213 [I] DB_PATCHES have already been applied
I20260810 14:49:41.219301 19575 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasko2eqSt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 14:49:41.219365 19575 mini_ranger.cc:193] Using host: 127.19.29.212
I20260810 14:49:41.223026 19575 mini_ranger.cc:227] Ranger admin URL: http://127.19.29.212:39281
Aug 10, 2026 2:49:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:49:41 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:49:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 2:49:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 2:49:41 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 2:49:42 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 2:49:42 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 14:49:42.441062 19575 mini_ranger.cc:160] Time spent starting Ranger: real 8.310s user 0.002s sys 0.008s
Aug 10, 2026 2:50:00 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 2:50:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 10, 2026 2:50:01 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 2:50:01 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 2:50:01 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 14:50:02.512234 19575 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangerkms_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/rangerkms_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.29.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.29.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 14:50:02 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373402, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 14:50:02.605067 19575 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 14:50:02.615092 19575 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 14:50:03.338656 19575 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 14:50:03.338745 19575 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms
I20260810 14:50:03.338762 19575 mini_ranger_kms.cc:227] Using postgres at 127.19.29.212:41945
2026-08-10 14:50:03,603 [I] DB FLAVOR :POSTGRES
2026-08-10 14:50:03,603 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:50:03,604 [I] Checking connection
2026-08-10 14:50:03,604 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 14:50:03,874 [I] connection success
2026-08-10 14:50:03,874 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 14:50:03,874 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 14:50:03,874 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 14:50:04,157 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 14:50:04,157 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:50:04,158 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 14:50:04,158 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:41945/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 14:50:04,494 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 14:50:04.953106 19575 mini_ranger_kms.cc:310] Created kms service
I20260810 14:50:05.132159 19575 mini_ranger_kms.cc:326] Created kudu user
I20260810 14:50:05.175186 19575 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 14:50:05 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373402, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:05.552927 19575 mini_ranger_kms.cc:384] Added ranger policy
I20260810 14:50:05.553043 19575 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms:/tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 14:50:05.553064 19575 mini_ranger_kms.cc:240] Using host: 127.19.29.212
I20260810 14:50:05.557132 19575 mini_ranger_kms.cc:276] Ranger KMS PID: 5769
I20260810 14:50:05.557252 19575 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.29.212:42565
Aug 10, 2026 2:50:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:50:06 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:50:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 2:50:06 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 2:50:07 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 2:50:07 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 14:50:07 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786373407, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:08.105881 19575 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.501s user 0.000s sys 0.247s
I20260810 14:50:08.106001 19575 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 14:50:08.106102 19575 mini_ranger_kms.cc:401] 127.19.29.212:42565/kms/v1/keys
Aug 10 14:50:08 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373407, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
Aug 10 14:50:08 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373407, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
Aug 10 14:50:10 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:50:10.907444 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37809
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37809
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:42565/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:10.990880 5862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:10.991102 5862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:10.991125 5862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:10.992259 5862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:50:10.992297 5862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:10.992309 5862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:10.992321 5862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:50:10.992331 5862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:50:10.993940 5862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.29.212:42565/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37809
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37809
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:10.994154 5862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:10.994400 5862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:10.999146 5870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:10.999146 5873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:10.999217 5878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:10.999480 5862 server_base.cc:1034] running on GCE node
I20260810 14:50:10.999716 5862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:11.000008 5862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:11.001157 5862 hybrid_clock.cc:648] HybridClock initialized: now 1786373411001143 us; error 32 us; skew 500 ppm
Aug 10 14:50:11 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:11.008810 5862 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:50:11.009267 5862 webserver.cc:460] Webserver started at http://127.19.29.254:40637/ using document root <none> and password file <none>
I20260810 14:50:11.009461 5862 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:11.009500 5862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:11.009619 5862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:11 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:11.056948 5862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "cb4100dda6624c93a28f125c262d7818"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "a0f615785c3bd7815471bfe176e60ed7"
server_key_iv: "3506a819cebed8dfca4cf4eb7f01cde4"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.057320 5862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "cb4100dda6624c93a28f125c262d7818"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "a0f615785c3bd7815471bfe176e60ed7"
server_key_iv: "3506a819cebed8dfca4cf4eb7f01cde4"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.058796 5862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:50:11.069984 5893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:11.070182 5862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:11.070331 5862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "cb4100dda6624c93a28f125c262d7818"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "a0f615785c3bd7815471bfe176e60ed7"
server_key_iv: "3506a819cebed8dfca4cf4eb7f01cde4"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.070421 5862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:11.083729 5862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:11.085497 5862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:11.085630 5862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:11.090421 5862 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:37809
I20260810 14:50:11.090446 5972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:37809 every 8 connection(s)
I20260810 14:50:11.090785 5862 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:50:11.091460 5973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:11.093649 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 5862
I20260810 14:50:11.093746 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:50:11.093778 5973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: Bootstrap starting.
I20260810 14:50:11.093930 19575 external_mini_cluster.cc:1428] Setting key 8adc3f527611fdab7e5b95cb5ccc24fd
I20260810 14:50:11.094771 5973 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:11.095069 5973 log.cc:824] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:11.095779 5973 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: No bootstrap required, opened a new log
I20260810 14:50:11.097796 5973 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } }
I20260810 14:50:11.097968 5973 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:11.098002 5973 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb4100dda6624c93a28f125c262d7818, State: Initialized, Role: FOLLOWER
I20260810 14:50:11.098158 5973 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } }
I20260810 14:50:11.098244 5973 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:50:11.098273 5973 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:50:11.098359 5973 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:11.098970 5973 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } }
I20260810 14:50:11.099068 5973 leader_election.cc:302] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb4100dda6624c93a28f125c262d7818; no voters:
I20260810 14:50:11.099253 5973 leader_election.cc:288] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:50:11.099624 5973 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:50:11.099298 5985 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:50:11.099813 5985 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [term 1 LEADER]: Becoming Leader. State: Replica: cb4100dda6624c93a28f125c262d7818, State: Running, Role: LEADER
I20260810 14:50:11.099902 5985 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } }
I20260810 14:50:11.100317 5986 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb4100dda6624c93a28f125c262d7818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } } }
I20260810 14:50:11.100400 5986 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [sys.catalog]: This master's current role is: LEADER
I20260810 14:50:11.100781 5987 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb4100dda6624c93a28f125c262d7818. Latest consensus state: current_term: 1 leader_uuid: "cb4100dda6624c93a28f125c262d7818" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb4100dda6624c93a28f125c262d7818" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37809 } } }
I20260810 14:50:11.100909 5987 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818 [sys.catalog]: This master's current role is: LEADER
Aug 10 14:50:11 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373410, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:11.101662 5989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:50:11.102169 5989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:50:11.102694 5973 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:50:11.109246 5980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:11.094476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37018 (local address 127.19.29.254:37809)
0810 14:50:11.094679 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:11.094690 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:11.094730 (+ 40us) server_negotiation.cc:407] Connection header received
0810 14:50:11.095275 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:11.095285 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:11.095353 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:11.095501 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:11.096237 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:11.097663 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:11.098695 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:11.099319 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:11.099423 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:11.102222 (+ 2799us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:11.102227 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:11.102227 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:11.102239 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:11.106881 (+ 4642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:11.107331 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:11.107335 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:11.107335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:11.107444 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:11.107653 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:11.107654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:11.107654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:11.108001 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:11.108759 (+ 758us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:11.108830 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 14:50:11.108983 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":80,"threads_started":1}
I20260810 14:50:11.114956 5989 catalog_manager.cc:1347] Generated new cluster ID: 97761c432dc24f6da0baafe96e5de7a4
I20260810 14:50:11.115010 5989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:50:11.137805 5989 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:50:11.138801 5989 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:50:11.148430 5989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: Generated new TSK 0
I20260810 14:50:11.148613 5989 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:50:11.825289 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:42565/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:11.912212 6051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:11.912400 6051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:11.912421 6051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:11.913530 6051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:11.913570 6051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:11.913594 6051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:50:11.915138 6051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.29.212:42565/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6051
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:11.915371 6051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:11.915597 6051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:11.920630 6058 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:11.920799 6051 server_base.cc:1034] running on GCE node
W20260810 14:50:11.920840 6062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:11.920637 6059 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:11.921168 6051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:11.921427 6051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:11.922577 6051 hybrid_clock.cc:648] HybridClock initialized: now 1786373411922560 us; error 31 us; skew 500 ppm
Aug 10 14:50:11 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:11.928314 6051 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:50:11.928745 6051 webserver.cc:460] Webserver started at http://127.19.29.193:44711/ using document root <none> and password file <none>
I20260810 14:50:11.928961 6051 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:11.929009 6051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:11.929147 6051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:11 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:11.943039 6051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "7a58eb2fa2094460b3fee123580adc2f"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "fd21579a7eda4c309a1152dcb671a5ee"
server_key_iv: "31b35c635e4911e641b8d65f0dc457ea"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.943502 6051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "7a58eb2fa2094460b3fee123580adc2f"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "fd21579a7eda4c309a1152dcb671a5ee"
server_key_iv: "31b35c635e4911e641b8d65f0dc457ea"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.945700 6051 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:50:11.966449 6071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:11.966686 6051 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.001s sys 0.000s
I20260810 14:50:11.966790 6051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "7a58eb2fa2094460b3fee123580adc2f"
format_stamp: "Formatted at 2026-08-10 14:50:11 on dist-test-slave-4tdj"
server_key: "fd21579a7eda4c309a1152dcb671a5ee"
server_key_iv: "31b35c635e4911e641b8d65f0dc457ea"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:11.966892 6051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:11.995043 6051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:11.998800 6051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:11.999034 6051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:11.999450 6051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:11.999951 6051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:12.000061 6051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.000159 6051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:12.000227 6051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.007624 6051 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:40643
I20260810 14:50:12.007714 6258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:40643 every 8 connection(s)
I20260810 14:50:12.008015 6051 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:50:12.011045 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 6051
I20260810 14:50:12.011135 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:50:12.011298 19575 external_mini_cluster.cc:1428] Setting key d70b7db054f0661ab03b78f69c5b8fc4
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373411, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:12.018612 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.008743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:32997 (local address 127.19.29.254:37809)
0810 14:50:12.009834 (+ 1091us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.009836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.009848 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:50:12.009876 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.009877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.009890 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.009982 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:12.010653 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.011457 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.012777 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.013029 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.013084 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.015483 (+ 2399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:12.015484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:12.015485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:12.015492 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:12.017012 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.017488 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.017489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.017489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.017558 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.017855 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.017856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.017857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.017996 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:12.018072 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.018436 (+ 364us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.018525 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1060,"thread_start_us":84,"threads_started":1}
I20260810 14:50:12.018769 6262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.008716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37809 (local address 127.19.29.193:32997)
0810 14:50:12.008878 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.008922 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.009379 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.010053 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.010057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.010281 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:12.010557 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.010562 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.011635 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.011636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.012680 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.012684 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.013155 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.013157 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.013295 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.013867 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:12.013879 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:12.015371 (+ 1492us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:12.017099 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.017106 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.017108 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.017391 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.017633 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.017634 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.017634 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.017771 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.018071 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:12.018078 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:12.018233 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.018388 (+ 155us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.018546 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260810 14:50:12.019393 6260 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37809
I20260810 14:50:12.019505 6260 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:12.019681 6260 heartbeater.cc:511] Master 127.19.29.254:37809 requested a full tablet report, sending...
I20260810 14:50:12.020275 5923 ts_manager.cc:194] Registered new tserver with Master: 7a58eb2fa2094460b3fee123580adc2f (127.19.29.193:40643)
I20260810 14:50:12.021149 5923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:32997
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:50:12.045246 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:42565/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:12.166390 6266 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:12.166738 6266 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:12.166811 6266 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:12.168540 6266 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:12.168634 6266 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:12.168705 6266 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:50:12.170920 6266 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.29.212:42565/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6266
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:12.171381 6266 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:12.171859 6266 file_cache.cc:493] Constructed file cache file cache with capacity 419430
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 14:50:12.182082 6284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:12.182466 6281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:12.182724 6280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:12.182821 6266 server_base.cc:1034] running on GCE node
I20260810 14:50:12.183125 6266 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:12.183399 6266 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:12.186981 6266 hybrid_clock.cc:648] HybridClock initialized: now 1786373412186953 us; error 38 us; skew 500 ppm
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:12.190673 6266 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:50:12.191164 6266 webserver.cc:460] Webserver started at http://127.19.29.194:34089/ using document root <none> and password file <none>
I20260810 14:50:12.191426 6266 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:12.191478 6266 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:12.191617 6266 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:12.208951 6266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "32182b8eefe44e0db62004a41b9e2349"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "5e136675c00b62735a5e259dc5c77e82"
server_key_iv: "f8c7948566a2d07861f8c81749374d0f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.209486 6266 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "32182b8eefe44e0db62004a41b9e2349"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "5e136675c00b62735a5e259dc5c77e82"
server_key_iv: "f8c7948566a2d07861f8c81749374d0f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.211468 6266 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:50:12.238204 6296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.238489 6266 fs_manager.cc:725] Time spent opening block manager: real 0.014s user 0.001s sys 0.000s
I20260810 14:50:12.238586 6266 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "32182b8eefe44e0db62004a41b9e2349"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "5e136675c00b62735a5e259dc5c77e82"
server_key_iv: "f8c7948566a2d07861f8c81749374d0f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.238672 6266 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:12.256359 6266 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:12.258787 6266 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:12.258972 6266 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:12.259260 6266 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:12.259613 6266 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:12.259686 6266 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.259740 6266 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:12.259781 6266 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.267419 6266 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:45615
I20260810 14:50:12.267814 6266 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:50:12.268354 6496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:45615 every 8 connection(s)
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:12.274098 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 6266
I20260810 14:50:12.274202 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:50:12.274425 19575 external_mini_cluster.cc:1428] Setting key 74394c5fea21485970740fb7efed54a8
I20260810 14:50:12.277170 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.268638 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:45415 (local address 127.19.29.254:37809)
0810 14:50:12.268690 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.268692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.268920 (+ 228us) server_negotiation.cc:407] Connection header received
0810 14:50:12.269422 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.269423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.269439 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.269491 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:12.270021 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.270665 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.271741 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.271937 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.271988 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.274153 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:12.274155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:12.274155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:12.274163 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:12.275697 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.276134 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.276135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.276136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.276194 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.276437 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.276438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.276438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.276574 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:12.276614 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.276981 (+ 367us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.277079 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:50:12.277837 6502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.268646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37809 (local address 127.19.29.194:45415)
0810 14:50:12.268799 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.268835 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.269320 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.269561 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.269565 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.269740 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:12.269927 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.269931 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.270758 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.270759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.271656 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.271659 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.272001 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.272002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.272134 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.272603 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:12.272611 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:12.274046 (+ 1435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:12.275787 (+ 1741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.275795 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.275797 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.276054 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.276257 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.276258 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.276258 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.276372 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.276664 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:12.276671 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:12.276827 (+ 156us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.277455 (+ 628us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.277623 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":80,"threads_started":1}
I20260810 14:50:12.278368 6498 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37809
I20260810 14:50:12.278496 6498 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:12.278712 6498 heartbeater.cc:511] Master 127.19.29.254:37809 requested a full tablet report, sending...
I20260810 14:50:12.279107 5923 ts_manager.cc:194] Registered new tserver with Master: 32182b8eefe44e0db62004a41b9e2349 (127.19.29.194:45615)
I20260810 14:50:12.279562 5923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:45415
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:50:12.306790 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:42565/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:39089
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:12.423405 6505 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:12.423611 6505 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:12.423632 6505 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:12.424742 6505 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:12.424778 6505 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:12.424803 6505 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:50:12.426234 6505 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:39089
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.29.212:42565/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:37809
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6505
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:12.426474 6505 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:12.426695 6505 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:12.431587 6511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:12.431595 6512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:12.431627 6516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:12.432037 6505 server_base.cc:1034] running on GCE node
I20260810 14:50:12.432227 6505 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:12.432435 6505 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:12.433617 6505 hybrid_clock.cc:648] HybridClock initialized: now 1786373412433603 us; error 29 us; skew 500 ppm
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:12.436369 6505 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:50:12.436800 6505 webserver.cc:460] Webserver started at http://127.19.29.195:36841/ using document root <none> and password file <none>
I20260810 14:50:12.437016 6505 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:12.437059 6505 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:12.437177 6505 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:12.468366 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "dbac6bb2ec384360a7d8d2796f830683"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "babaff51d908f224473943d9819d7a1c"
server_key_iv: "90ca8da51346e87f4b0b6de6c1d07df5"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.468915 6505 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "dbac6bb2ec384360a7d8d2796f830683"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "babaff51d908f224473943d9819d7a1c"
server_key_iv: "90ca8da51346e87f4b0b6de6c1d07df5"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.472833 6505 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260810 14:50:12.491984 6524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.492189 6505 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.000s sys 0.000s
I20260810 14:50:12.492318 6505 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "dbac6bb2ec384360a7d8d2796f830683"
format_stamp: "Formatted at 2026-08-10 14:50:12 on dist-test-slave-4tdj"
server_key: "babaff51d908f224473943d9819d7a1c"
server_key_iv: "90ca8da51346e87f4b0b6de6c1d07df5"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:12.492440 6505 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:12.518792 6505 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:12.522418 6505 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:12.522603 6505 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:12.522835 6505 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:12.523259 6505 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:12.523315 6505 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.523348 6505 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:12.523372 6505 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:12.530603 6505 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:43225
I20260810 14:50:12.531111 6505 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:50:12.533607 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 6505
I20260810 14:50:12.533721 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:50:12.533901 19575 external_mini_cluster.cc:1428] Setting key 9090d57bf322d80e6d1369f3abb75036
I20260810 14:50:12.540411 6701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:43225 every 8 connection(s)
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:12.552450 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.541367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:40901 (local address 127.19.29.254:37809)
0810 14:50:12.541417 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.541419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.541747 (+ 328us) server_negotiation.cc:407] Connection header received
0810 14:50:12.542521 (+ 774us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.542522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.542534 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.542563 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:12.543413 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.544206 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.546385 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.546687 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.546728 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.549307 (+ 2579us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:12.549309 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:12.549309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:12.549316 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:12.550870 (+ 1554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.551378 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.551379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.551379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.551437 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.551705 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.551706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.551707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.551838 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:12.551879 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.552265 (+ 386us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.552352 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:50:12.553277 6705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.541391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37809 (local address 127.19.29.195:40901)
0810 14:50:12.541610 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.541663 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.542398 (+ 735us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.542751 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.542756 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.543010 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:12.543294 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.543300 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.544345 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.544346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.546262 (+ 1916us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.546265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.546817 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.546818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.546956 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.547533 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:12.547544 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:12.549198 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:12.550957 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.550963 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.550966 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.551285 (+ 319us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.551503 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:12.551504 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:12.551504 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:12.551636 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:12.551922 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:12.551928 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:12.552092 (+ 164us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.552804 (+ 712us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.552972 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":129,"threads_started":1}
I20260810 14:50:12.553927 6703 heartbeater.cc:347] Connected to a master server at 127.19.29.254:37809
I20260810 14:50:12.554026 6703 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:12.554231 6703 heartbeater.cc:511] Master 127.19.29.254:37809 requested a full tablet report, sending...
I20260810 14:50:12.554688 5923 ts_manager.cc:194] Registered new tserver with Master: dbac6bb2ec384360a7d8d2796f830683 (127.19.29.195:43225)
I20260810 14:50:12.555186 5923 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:40901
I20260810 14:50:12.556597 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:50:12.566215 6263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.558608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37022 (local address 127.19.29.254:37809)
0810 14:50:12.558645 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.558647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.558907 (+ 260us) server_negotiation.cc:407] Connection header received
0810 14:50:12.558994 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.558995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.559005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.559031 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:12.559820 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.560513 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.561595 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.561863 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.561909 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.563508 (+ 1599us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:12.563510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:12.563511 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:12.563518 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:12.565002 (+ 1484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.565421 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.565423 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.565423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.565476 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:12.565641 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:12.565641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:12.565641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:12.565750 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:12.565813 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.565993 (+ 180us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.566063 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:50:12.568312 5923 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37022:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:50:12.570406 5923 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:50:12.586776 6726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.574198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43225 (local address 127.0.0.1:57390)
0810 14:50:12.575419 (+ 1221us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.575425 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.575454 (+ 29us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.575843 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.575846 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.575848 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:12.575904 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.575906 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.583183 (+ 7277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.583183 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.584200 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.584203 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.586482 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.586483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.586565 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.586579 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.586644 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.586694 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1209,"thread_start_us":69,"threads_started":1}
I20260810 14:50:12.587772 6722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.574357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45615 (local address 127.0.0.1:33784)
0810 14:50:12.577048 (+ 2691us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.577057 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.577097 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.577350 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.577350 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.577352 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:12.577404 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.577406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.578559 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.578560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.582782 (+ 4222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.582785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.587546 (+ 4761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.587547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.587620 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.587624 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.587666 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.587704 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2677,"thread_start_us":55,"threads_started":1}
I20260810 14:50:12.589170 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.573734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:40643 (local address 127.0.0.1:40846)
0810 14:50:12.575236 (+ 1502us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.575274 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.575331 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.579549 (+ 4218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.579549 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.579551 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:12.579598 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.579600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.580758 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.580759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.584381 (+ 3622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.584383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.588925 (+ 4542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.588926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.588997 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.589001 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.589047 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.589084 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1473,"thread_start_us":73,"threads_started":1}
I20260810 14:50:12.590083 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.574820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33784 (local address 127.19.29.194:45615)
0810 14:50:12.575802 (+ 982us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.575806 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.577147 (+ 1341us) server_negotiation.cc:407] Connection header received
0810 14:50:12.577202 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.577204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.577219 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.577277 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:12.577465 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.578475 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.584487 (+ 6012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.587358 (+ 2871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.587419 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.589932 (+ 2513us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.589963 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.590006 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":948,"thread_start_us":71,"threads_started":1}
I20260810 14:50:12.590457 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.574674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57390 (local address 127.19.29.195:43225)
0810 14:50:12.575553 (+ 879us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.575557 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.575566 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:50:12.575603 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.575605 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.575621 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.575682 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:12.575973 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.583103 (+ 7130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.585473 (+ 2370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.586274 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.586362 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.586447 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.590326 (+ 3879us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.590373 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":843,"thread_start_us":72,"threads_started":1}
I20260810 14:50:12.591290 6359 tablet_service.cc:1467] Processing CreateTablet for tablet 449197754578417aa4bf8ea254075ebc (DEFAULT_TABLE table=test-table [id=f358bf68f50d4d90a3a68ee54567c06c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:12.591699 6359 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449197754578417aa4bf8ea254075ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:12.596454 6592 tablet_service.cc:1467] Processing CreateTablet for tablet 449197754578417aa4bf8ea254075ebc (DEFAULT_TABLE table=test-table [id=f358bf68f50d4d90a3a68ee54567c06c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:12.596798 6592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449197754578417aa4bf8ea254075ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:12.600391 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.573985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40846 (local address 127.19.29.193:40643)
0810 14:50:12.579345 (+ 5360us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.579349 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.579360 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:50:12.579392 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.579394 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.579410 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.579478 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:12.579662 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.580669 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.587992 (+ 7323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.588767 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.588834 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.588890 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.600225 (+ 11335us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.600284 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5323,"thread_start_us":68,"threads_started":1}
I20260810 14:50:12.601117 6160 tablet_service.cc:1467] Processing CreateTablet for tablet 449197754578417aa4bf8ea254075ebc (DEFAULT_TABLE table=test-table [id=f358bf68f50d4d90a3a68ee54567c06c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:12.601450 6160 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 449197754578417aa4bf8ea254075ebc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:12.605014 6738 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Bootstrap starting.
I20260810 14:50:12.605754 6739 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Bootstrap starting.
I20260810 14:50:12.606287 6738 tablet_bootstrap.cc:654] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:12.607004 6739 tablet_bootstrap.cc:654] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:12.607395 6738 log.cc:824] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:12.607623 6731 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Bootstrap starting.
I20260810 14:50:12.608923 6731 tablet_bootstrap.cc:654] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:12.607986 6739 log.cc:824] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:12.609686 6731 log.cc:824] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:12.610841 6738 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: No bootstrap required, opened a new log
I20260810 14:50:12.610947 6738 ts_tablet_manager.cc:1397] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260810 14:50:12.613165 6738 raft_consensus.cc:348] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.613430 6738 raft_consensus.cc:374] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:12.613521 6738 raft_consensus.cc:729] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbac6bb2ec384360a7d8d2796f830683, State: Initialized, Role: FOLLOWER
I20260810 14:50:12.613706 6738 consensus_queue.cc:260] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.614049 6738 ts_tablet_manager.cc:1428] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:50:12.614214 6703 heartbeater.cc:503] Master 127.19.29.254:37809 was elected leader, sending a full tablet report...
I20260810 14:50:12.615533 6739 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: No bootstrap required, opened a new log
I20260810 14:50:12.615657 6739 ts_tablet_manager.cc:1397] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s
I20260810 14:50:12.618459 6739 raft_consensus.cc:348] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.618676 6739 raft_consensus.cc:374] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:12.618755 6739 raft_consensus.cc:729] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a58eb2fa2094460b3fee123580adc2f, State: Initialized, Role: FOLLOWER
I20260810 14:50:12.618939 6739 consensus_queue.cc:260] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.619268 6739 ts_tablet_manager.cc:1428] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260810 14:50:12.619412 6260 heartbeater.cc:503] Master 127.19.29.254:37809 was elected leader, sending a full tablet report...
I20260810 14:50:12.620648 6731 tablet_bootstrap.cc:492] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: No bootstrap required, opened a new log
I20260810 14:50:12.620771 6731 ts_tablet_manager.cc:1397] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s
I20260810 14:50:12.623100 6731 raft_consensus.cc:348] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.623317 6731 raft_consensus.cc:374] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:12.623389 6731 raft_consensus.cc:729] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32182b8eefe44e0db62004a41b9e2349, State: Initialized, Role: FOLLOWER
I20260810 14:50:12.623647 6731 consensus_queue.cc:260] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.623942 6731 ts_tablet_manager.cc:1428] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:50:12.624075 6498 heartbeater.cc:503] Master 127.19.29.254:37809 was elected leader, sending a full tablet report...
Aug 10 14:50:12 dist-test-slave-4tdj krb5kdc[5077](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373412, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
W20260810 14:50:12.758934 6261 tablet.cc:2369] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:50:12.760418 6746 raft_consensus.cc:482] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:50:12.760545 6746 raft_consensus.cc:504] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.760946 6746 leader_election.cc:288] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a58eb2fa2094460b3fee123580adc2f (127.19.29.193:40643), dbac6bb2ec384360a7d8d2796f830683 (127.19.29.195:43225)
I20260810 14:50:12.765038 6502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.761167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:40643 (local address 127.19.29.194:50411)
0810 14:50:12.761212 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.761225 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.761271 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.761854 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.761855 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.761858 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:12.761928 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.761929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.762818 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.762819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.764000 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.764003 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.764790 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.764791 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.764878 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.764882 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.764925 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.764963 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 14:50:12.765545 6723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.761552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:50411 (local address 127.19.29.193:40643)
0810 14:50:12.761658 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.761660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.761669 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:50:12.761697 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.761698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.761709 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.761763 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:12.761998 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.762719 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.764101 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.764678 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.764746 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.764756 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.765435 (+ 679us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.765477 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260810 14:50:12.765817 6181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449197754578417aa4bf8ea254075ebc" candidate_uuid: "32182b8eefe44e0db62004a41b9e2349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a58eb2fa2094460b3fee123580adc2f" is_pre_election: true
I20260810 14:50:12.765980 6181 raft_consensus.cc:2454] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32182b8eefe44e0db62004a41b9e2349 in term 0.
I20260810 14:50:12.766218 6298 leader_election.cc:302] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32182b8eefe44e0db62004a41b9e2349, 7a58eb2fa2094460b3fee123580adc2f; no voters:
I20260810 14:50:12.766387 6746 raft_consensus.cc:2781] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:50:12.766441 6746 raft_consensus.cc:482] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:50:12.766469 6746 raft_consensus.cc:3037] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:12.767378 6746 raft_consensus.cc:504] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.767524 6746 leader_election.cc:288] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [CANDIDATE]: Term 1 election: Requested vote from peers 7a58eb2fa2094460b3fee123580adc2f (127.19.29.193:40643), dbac6bb2ec384360a7d8d2796f830683 (127.19.29.195:43225)
I20260810 14:50:12.767730 6181 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449197754578417aa4bf8ea254075ebc" candidate_uuid: "32182b8eefe44e0db62004a41b9e2349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a58eb2fa2094460b3fee123580adc2f"
I20260810 14:50:12.767817 6181 raft_consensus.cc:3037] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:12.768697 6181 raft_consensus.cc:2454] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32182b8eefe44e0db62004a41b9e2349 in term 1.
W20260810 14:50:12.768862 6499 tablet.cc:2369] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:50:12.769167 6298 leader_election.cc:302] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32182b8eefe44e0db62004a41b9e2349, 7a58eb2fa2094460b3fee123580adc2f; no voters:
I20260810 14:50:12.769248 6746 raft_consensus.cc:2781] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:50:12.769476 6746 raft_consensus.cc:686] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 1 LEADER]: Becoming Leader. State: Replica: 32182b8eefe44e0db62004a41b9e2349, State: Running, Role: LEADER
I20260810 14:50:12.769574 6746 consensus_queue.cc:237] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } }
I20260810 14:50:12.770505 5923 catalog_manager.cc:5495] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 reported cstate change: term changed from 0 to 1, leader changed from <none> to 32182b8eefe44e0db62004a41b9e2349 (127.19.29.194). New cstate: current_term: 1 leader_uuid: "32182b8eefe44e0db62004a41b9e2349" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32182b8eefe44e0db62004a41b9e2349" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45615 } health_report { overall_health: HEALTHY } } }
I20260810 14:50:12.774869 6502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.761308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43225 (local address 127.19.29.194:55219)
0810 14:50:12.765120 (+ 3812us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.765130 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.765170 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.771628 (+ 6458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:12.771629 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:12.771631 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:12.771671 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.771672 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.772698 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.772700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.773870 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:12.773873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.774649 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.774650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:12.774710 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.774714 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:12.774759 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:50:12.774796 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3799,"thread_start_us":81,"threads_started":1}
I20260810 14:50:12.775138 6729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.761604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:55219 (local address 127.19.29.195:43225)
0810 14:50:12.761819 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.761820 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.765239 (+ 3419us) server_negotiation.cc:407] Connection header received
0810 14:50:12.765269 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.765270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.765279 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.765321 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:12.771759 (+ 6438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.772527 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.773966 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.774526 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.774594 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.774604 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.775034 (+ 430us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.775077 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191}
I20260810 14:50:12.775468 6630 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449197754578417aa4bf8ea254075ebc" candidate_uuid: "32182b8eefe44e0db62004a41b9e2349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbac6bb2ec384360a7d8d2796f830683" is_pre_election: true
I20260810 14:50:12.775643 6630 raft_consensus.cc:2454] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 32182b8eefe44e0db62004a41b9e2349 in term 0.
I20260810 14:50:12.775784 6629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "449197754578417aa4bf8ea254075ebc" candidate_uuid: "32182b8eefe44e0db62004a41b9e2349" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbac6bb2ec384360a7d8d2796f830683"
I20260810 14:50:12.775848 6629 raft_consensus.cc:3037] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:12.776813 6629 raft_consensus.cc:2454] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 32182b8eefe44e0db62004a41b9e2349 in term 1.
W20260810 14:50:12.796772 6704 tablet.cc:2369] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:50:12.818413 6730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:12.814948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33796 (local address 127.19.29.194:45615)
0810 14:50:12.815030 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:12.815032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:12.815043 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:50:12.815093 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:12.815094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:12.815120 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:12.815199 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:50:12.815427 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.816104 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.817083 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:12.817392 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:12.817468 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:12.817715 (+ 247us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:50:12.817869 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:50:12.817967 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:12.818232 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 14:50:12.818260 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260810 14:50:12.820712 6629 raft_consensus.cc:1261] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 1 FOLLOWER]: Refusing update from remote peer 32182b8eefe44e0db62004a41b9e2349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:50:12.820732 6181 raft_consensus.cc:1261] T 449197754578417aa4bf8ea254075ebc P 7a58eb2fa2094460b3fee123580adc2f [term 1 FOLLOWER]: Refusing update from remote peer 32182b8eefe44e0db62004a41b9e2349: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:50:12.821070 6746 consensus_queue.cc:1035] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a58eb2fa2094460b3fee123580adc2f" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 40643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:50:12.821233 6746 consensus_queue.cc:1035] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbac6bb2ec384360a7d8d2796f830683" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43225 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:50:12.823575 6760 mvcc.cc:205] Tried to move back new op lower bound from 7316985498910433280 to 7316985498704793600. Current Snapshot: MvccSnapshot[applied={T|T < 7316985498910433280}]
I20260810 14:50:12.828683 6761 mvcc.cc:205] Tried to move back new op lower bound from 7316985498910433280 to 7316985498704793600. Current Snapshot: MvccSnapshot[applied={T|T < 7316985498910433280}]
I20260810 14:50:12.830814 6762 mvcc.cc:205] Tried to move back new op lower bound from 7316985498910433280 to 7316985498704793600. Current Snapshot: MvccSnapshot[applied={T|T < 7316985498910433280}]
I20260810 14:50:12.832762 5922 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:50:12.832855 5922 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37022:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:50:12.833676 5922 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cb4100dda6624c93a28f125c262d7818: Sending DeleteTablet for 3 replicas of tablet 449197754578417aa4bf8ea254075ebc
I20260810 14:50:12.834003 6160 tablet_service.cc:1514] Processing DeleteTablet for tablet 449197754578417aa4bf8ea254075ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:12 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40846
I20260810 14:50:12.834421 6592 tablet_service.cc:1514] Processing DeleteTablet for tablet 449197754578417aa4bf8ea254075ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:12 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:57390
I20260810 14:50:12.834842 6359 tablet_service.cc:1514] Processing DeleteTablet for tablet 449197754578417aa4bf8ea254075ebc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:12 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:33784
I20260810 14:50:12.835337 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 6051
I20260810 14:50:12.871069 6774 tablet_replica.cc:330] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: stopping tablet replica
I20260810 14:50:12.871366 6774 raft_consensus.cc:2229] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:50:12.871636 6775 tablet_replica.cc:330] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: stopping tablet replica
I20260810 14:50:12.871909 6774 raft_consensus.cc:2258] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:50:12.872126 6775 raft_consensus.cc:2229] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:50:12.872485 6775 raft_consensus.cc:2258] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:50:12.877947 6775 ts_tablet_manager.cc:1905] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:50:12.879889 6775 ts_tablet_manager.cc:1918] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:50:12.879979 6775 log.cc:1196] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/449197754578417aa4bf8ea254075ebc
I20260810 14:50:12.880260 6775 ts_tablet_manager.cc:1939] T 449197754578417aa4bf8ea254075ebc P 32182b8eefe44e0db62004a41b9e2349: Deleting consensus metadata
I20260810 14:50:12.880785 5898 catalog_manager.cc:4841] TS 32182b8eefe44e0db62004a41b9e2349 (127.19.29.194:45615): tablet 449197754578417aa4bf8ea254075ebc (table test-table [id=f358bf68f50d4d90a3a68ee54567c06c]) successfully deleted
I20260810 14:50:12.880817 6774 ts_tablet_manager.cc:1905] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:50:12.882701 6774 ts_tablet_manager.cc:1918] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:50:12.882777 6774 log.cc:1196] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/449197754578417aa4bf8ea254075ebc
I20260810 14:50:12.883109 6774 ts_tablet_manager.cc:1939] T 449197754578417aa4bf8ea254075ebc P dbac6bb2ec384360a7d8d2796f830683: Deleting consensus metadata
I20260810 14:50:12.883540 5898 catalog_manager.cc:4841] TS dbac6bb2ec384360a7d8d2796f830683 (127.19.29.195:43225): tablet 449197754578417aa4bf8ea254075ebc (table test-table [id=f358bf68f50d4d90a3a68ee54567c06c]) successfully deleted
W20260810 14:50:12.917713 5896 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:40643 (error 108)
W20260810 14:50:12.922937 6722 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:50:12.922596 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:40643 (local address 127.0.0.1:40856)
0810 14:50:12.922659 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:12.922676 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:12.922734 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:12.922876 (+ 142us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:40643: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 14:50:12.923276 5896 catalog_manager.cc:4584] TS 7a58eb2fa2094460b3fee123580adc2f (127.19.29.193:40643): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 449197754578417aa4bf8ea254075ebc: Network error: Client connection negotiation failed: client connection to 127.19.29.193:40643: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:50:12.930768 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 6266
I20260810 14:50:12.941741 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 6505
I20260810 14:50:12.953199 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 5862
I20260810 14:50:12.967448 19575 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 14:50:13.301177 19575 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 14:50:13.301275 19575 mini_ranger.cc:66] Stopping Ranger...
I20260810 14:50:13.645052 19575 mini_ranger.cc:68] Stopped Ranger
2026-08-10 14:50:13.645 UTC [5140] LOG: received smart shutdown request
2026-08-10 14:50:13.648 UTC [5140] LOG: background worker "logical replication launcher" (PID 5156) exited with exit code 1
2026-08-10 14:50:13.648 UTC [5148] LOG: shutting down
2026-08-10 14:50:13.791 UTC [5140] LOG: database system is shut down
2026-08-10T14:50:13Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (44391 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:50:13 dist-test-slave-4tdj krb5kdc[6794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:50:13 dist-test-slave-4tdj krb5kdc[6794](info): set up 2 sockets
Aug 10 14:50:13 dist-test-slave-4tdj krb5kdc[6794](info): commencing operation
krb5kdc: starting...
W20260810 14:50:15.059739 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.162s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:50:15 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:50:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:50:15Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangeradmin_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangeradmin_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangerlookup_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangerlookup_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
I20260810 14:50:15.215106 19575 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-tasko2eqSt/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/postgres -l logfile start
2026-08-10 14:50:17.442 UTC [6852] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-10 14:50:17.442 UTC [6852] LOG: listening on IPv4 address "127.19.29.212", port 44917
2026-08-10 14:50:17.445 UTC [6852] LOG: listening on Unix socket "/tmp/.s.PGSQL.44917"
2026-08-10 14:50:17.465 UTC [6860] LOG: database system was shut down at 2026-08-10 14:50:16 UTC
2026-08-10 14:50:17.468 UTC [6852] LOG: database system is ready to accept connections
I20260810 14:50:18.579694 19575 mini_postgres.cc:96] Postgres bound to 44917
2026-08-10 14:50:18.586 UTC [6873] FATAL: database "slave" does not exist
127.19.29.212:44917 - accepting connections
I20260810 14:50:18.587023 19575 mini_ranger.cc:161] Starting Ranger...
I20260810 14:50:18.601393 19575 mini_ranger.cc:84] Created miniranger Postgres user
I20260810 14:50:19.011606 19575 mini_ranger.cc:87] Created ranger Postgres database
I20260810 14:50:19.011686 19575 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin
2026-08-10 14:50:19,280 [I] DB FLAVOR :POSTGRES
2026-08-10 14:50:19,280 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:50:19,280 [I] Checking connection..
2026-08-10 14:50:19,281 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-10 14:50:19,536 [I] Checking connection passed.
2026-08-10 14:50:19,537 [I] --------- Verifying version history table ---------
2026-08-10 14:50:19,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:50:19,792 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:50:19,793 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:50:20,049 [I] Table x_db_version_h does not exist in database ranger
2026-08-10 14:50:20,049 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-10 14:50:20,049 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-10 14:50:20.301 UTC [6976] WARNING: there is no transaction in progress
2026-08-10 14:50:20,308 [I] create_dbversion_catalog.sql file imported successfully
2026-08-10 14:50:20,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-10 14:50:20,548 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-10 14:50:20,549 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:50:20,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-10 14:50:20,788 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-10 14:50:21,027 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-4tdj.c.gcp-upstream.internal','N') ;"
2026-08-10 14:50:21,280 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:50:21,537 [I] Table x_portal_user does not exist in database ranger
2026-08-10 14:50:21,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:50:21,779 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-10 14:50:21,779 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:50:22,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:50:22,304 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-10 14:50:22,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-10 14:50:23.219 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.235 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.250 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.263 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.277 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.296 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.355 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.361 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.374 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.383 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.392 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.405 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.414 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.419 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.425 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:23.432 UTC [7169] WARNING: there is no transaction in progress
2026-08-10 14:50:24,011 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-10 14:50:24,011 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-10 14:50:24,264 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-10 14:50:24,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-10 14:50:24,505 [I] Table x_portal_user already exists in database 'ranger'
2026-08-10 14:50:24,506 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-10 14:50:24,761 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-10 14:50:24,761 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-10 14:50:24,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-10 14:50:25,240 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-4tdj.c.gcp-upstream.internal';"
2026-08-10 14:50:25,484 [I] CORE_DB_SCHEMA import status has been updated
2026-08-10 14:50:25,484 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-10 14:50:25,738 [I] DB_PATCHES have already been applied
I20260810 14:50:25.744300 19575 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-tasko2eqSt/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260810 14:50:25.744364 19575 mini_ranger.cc:193] Using host: 127.19.29.212
I20260810 14:50:25.748169 19575 mini_ranger.cc:227] Ranger admin URL: http://127.19.29.212:49931
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-admin/ews/webapp].
Aug 10, 2026 2:50:26 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260810 14:50:27.011720 19575 mini_ranger.cc:160] Time spent starting Ranger: real 8.425s user 0.000s sys 0.009s
Aug 10, 2026 2:50:45 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 10, 2026 2:50:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 10, 2026 2:50:45 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 10, 2026 2:50:45 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 10, 2026 2:50:46 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260810 14:50:47.118203 19575 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.19.29.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.19.29.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangerkms_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.19.29.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/rangerkms_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.19.29.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.19.29.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.19.29.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/HTTP_127.19.29.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 10 14:50:47 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373447, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260810 14:50:47.199131 19575 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260810 14:50:47.208827 19575 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260810 14:50:47.980593 19575 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260810 14:50:47.980664 19575 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms
I20260810 14:50:47.980680 19575 mini_ranger_kms.cc:227] Using postgres at 127.19.29.212:44917
2026-08-10 14:50:48,136 [I] DB FLAVOR :POSTGRES
2026-08-10 14:50:48,137 [I] --------- Verifying Ranger DB connection ---------
2026-08-10 14:50:48,137 [I] Checking connection
2026-08-10 14:50:48,137 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-10 14:50:48,384 [I] connection success
2026-08-10 14:50:48,385 [I] --------- Verifying Ranger DB tables ---------
2026-08-10 14:50:48,385 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-10 14:50:48,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-10 14:50:48,613 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-10 14:50:48,613 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-10 14:50:48,613 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-10 14:50:48,613 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.19.29.212:44917/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-10 14:50:48,864 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260810 14:50:49.289428 19575 mini_ranger_kms.cc:310] Created kms service
I20260810 14:50:49.454376 19575 mini_ranger_kms.cc:326] Created kudu user
I20260810 14:50:49.497146 19575 mini_ranger_kms.cc:343] Created rangerkms user
Aug 10 14:50:49 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373447, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:49.848549 19575 mini_ranger_kms.cc:384] Added ranger policy
I20260810 14:50:49.848662 19575 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms:/tmp/dist-test-tasko2eqSt/build/release/bin/postgresql.jar:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-tasko2eqSt/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260810 14:50:49.848680 19575 mini_ranger_kms.cc:240] Using host: 127.19.29.212
I20260810 14:50:49.853497 19575 mini_ranger_kms.cc:276] Ranger KMS PID: 7493
I20260810 14:50:49.853567 19575 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.19.29.212:33905
Aug 10, 2026 2:50:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 10, 2026 2:50:50 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 10, 2026 2:50:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 10, 2026 2:50:50 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 10, 2026 2:50:51 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-kms/ews/webapp].
Aug 10, 2026 2:50:51 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 10 14:50:51 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786373451, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 14:50:52 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373451, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:52.404078 19575 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.205s user 0.004s sys 0.137s
I20260810 14:50:52.404184 19575 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260810 14:50:52.404235 19575 mini_ranger_kms.cc:401] 127.19.29.212:33905/kms/v1/keys
Aug 10 14:50:52 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373451, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.19.29.212@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
Aug 10 14:50:54 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:50:54.931130 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:42805
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:42805
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:55.011559 7572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:55.011747 7572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:55.011766 7572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:55.012883 7572 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:50:55.012923 7572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:55.012935 7572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:55.012946 7572 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:50:55.012956 7572 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:50:55.014500 7572 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
--ranger_kms_url=127.19.29.212:33905/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:42805
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:42805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:55.014712 7572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:55.014914 7572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:50:55.020063 7572 server_base.cc:1034] running on GCE node
W20260810 14:50:55.020090 7578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:55.020112 7581 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:55.020324 7585 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:55.020817 7572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:55.021158 7572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:55.022336 7572 hybrid_clock.cc:648] HybridClock initialized: now 1786373455022307 us; error 43 us; skew 500 ppm
Aug 10 14:50:55 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:55.025557 7572 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:50:55.026052 7572 webserver.cc:460] Webserver started at http://127.19.29.254:35513/ using document root <none> and password file <none>
I20260810 14:50:55.026376 7572 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:55.026432 7572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:55.026587 7572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:55 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:55.086762 7572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "b06fb4971d7c40f8953a2013f0b234d9"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "3853e5a6ead8abae60afa7a64f8b019c"
server_key_iv: "648b1bb4f92a645aa5868f52d6f6d31f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:55.087272 7572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "b06fb4971d7c40f8953a2013f0b234d9"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "3853e5a6ead8abae60afa7a64f8b019c"
server_key_iv: "648b1bb4f92a645aa5868f52d6f6d31f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:55.088792 7572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:55.104277 7598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:55.104621 7572 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:50:55.104727 7572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "b06fb4971d7c40f8953a2013f0b234d9"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "3853e5a6ead8abae60afa7a64f8b019c"
server_key_iv: "648b1bb4f92a645aa5868f52d6f6d31f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:55.104818 7572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:55.128630 7572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:55.130688 7572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:55.130841 7572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:55.135110 7572 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:42805
I20260810 14:50:55.135151 7679 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:42805 every 8 connection(s)
I20260810 14:50:55.135509 7572 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:50:55.136200 7682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:55.136935 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 7572
I20260810 14:50:55.137020 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:50:55.137195 19575 external_mini_cluster.cc:1428] Setting key 1279cf8cc0f281844a858d8c65a12bb6
I20260810 14:50:55.139190 7682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Bootstrap starting.
I20260810 14:50:55.139928 7682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:55.140218 7682 log.cc:824] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:55.140866 7682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: No bootstrap required, opened a new log
I20260810 14:50:55.142686 7682 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:55.142820 7682 raft_consensus.cc:374] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:55.142841 7682 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06fb4971d7c40f8953a2013f0b234d9, State: Initialized, Role: FOLLOWER
I20260810 14:50:55.142951 7682 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:55.143020 7682 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:50:55.143043 7682 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:50:55.143088 7682 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 14:50:55 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:55.143616 7682 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:55.143716 7682 leader_election.cc:302] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06fb4971d7c40f8953a2013f0b234d9; no voters:
I20260810 14:50:55.143869 7682 leader_election.cc:288] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:50:55.143927 7694 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:50:55.144124 7682 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:50:55.144140 7694 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 LEADER]: Becoming Leader. State: Replica: b06fb4971d7c40f8953a2013f0b234d9, State: Running, Role: LEADER
I20260810 14:50:55.144327 7694 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:55.144727 7695 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b06fb4971d7c40f8953a2013f0b234d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } } }
I20260810 14:50:55.144804 7695 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:50:55.145036 7696 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06fb4971d7c40f8953a2013f0b234d9. Latest consensus state: current_term: 1 leader_uuid: "b06fb4971d7c40f8953a2013f0b234d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } } }
I20260810 14:50:55.145145 7696 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:50:55.145494 7710 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:50:55.145714 7682 ranger_client.cc:318] Using new properties file: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:50:55.148619 7710 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:50:55.150102 7690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:55.137665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56962 (local address 127.19.29.254:42805)
0810 14:50:55.137838 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:55.137848 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:55.137901 (+ 53us) server_negotiation.cc:407] Connection header received
0810 14:50:55.138410 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:55.138420 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:55.138487 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:55.138637 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:55.139171 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:55.140454 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:55.141202 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:55.141596 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:55.141688 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:55.143864 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:55.143870 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:55.143870 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:55.143883 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:55.145728 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:55.146116 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:55.146120 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:55.146120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:55.146204 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:55.147399 (+ 1195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:55.147432 (+ 33us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:55.147433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:55.148533 (+ 1100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:55.148857 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:55.149334 (+ 477us) server_negotiation.cc:299] Negotiation successful
0810 14:50:55.149821 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260810 14:50:55.151937 7710 catalog_manager.cc:1347] Generated new cluster ID: 0183d89e81724632a1cb3e9db3af6411
I20260810 14:50:55.151988 7710 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:50:55.177623 7710 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:50:55.178143 7710 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:50:55.182049 7710 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Generated new TSK 0
I20260810 14:50:55.182211 7710 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:50:55.846400 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:55.965651 7765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:55.965910 7765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:55.965943 7765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:55.967614 7765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:55.967674 7765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:55.967711 7765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:50:55.969794 7765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:55.970029 7765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:55.970376 7765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:55.976641 7777 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:55.976737 7771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:55.976647 7772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:55.978202 7765 server_base.cc:1034] running on GCE node
I20260810 14:50:55.978468 7765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:55.978829 7765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:55.979988 7765 hybrid_clock.cc:648] HybridClock initialized: now 1786373455979971 us; error 33 us; skew 500 ppm
Aug 10 14:50:55 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:55.982532 7765 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:50:55.982932 7765 webserver.cc:460] Webserver started at http://127.19.29.193:43303/ using document root <none> and password file <none>
I20260810 14:50:55.983160 7765 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:55.983215 7765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:55.983341 7765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:55 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:55.997888 7765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "0cc39073db9045ce8cf8104604a45389"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "d6e3d41b91b6e770369f4619fc56fde3"
server_key_iv: "94209cb9355d129fd24667e790188438"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:55.998394 7765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "0cc39073db9045ce8cf8104604a45389"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "d6e3d41b91b6e770369f4619fc56fde3"
server_key_iv: "94209cb9355d129fd24667e790188438"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.002720 7765 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s
I20260810 14:50:56.030404 7791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.038117 7765 fs_manager.cc:725] Time spent opening block manager: real 0.018s user 0.001s sys 0.000s
I20260810 14:50:56.038250 7765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "0cc39073db9045ce8cf8104604a45389"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "d6e3d41b91b6e770369f4619fc56fde3"
server_key_iv: "94209cb9355d129fd24667e790188438"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.038462 7765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:56.059475 7765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:56.061383 7765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:56.061533 7765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:56.061785 7765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:56.062139 7765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:56.062196 7765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.062227 7765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:56.062279 7765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.069199 7765 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:38637
I20260810 14:50:56.069307 8015 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:38637 every 8 connection(s)
I20260810 14:50:56.069694 7765 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:50:56.074474 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 7765
I20260810 14:50:56.074573 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:50:56.074739 19575 external_mini_cluster.cc:1428] Setting key fcc9fe31bb9ccd5a1cb56c33d67cd7c9
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373455, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:56.081516 8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.070449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:40711 (local address 127.19.29.254:42805)
0810 14:50:56.071262 (+ 813us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:56.071264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:56.071271 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:50:56.071293 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:56.071294 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:56.071305 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:56.071364 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:56.071918 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.072419 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.073365 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.073649 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.073713 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.078422 (+ 4709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:56.078423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:56.078423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:56.078431 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:56.080105 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.080583 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.080584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.080584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.080649 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.080891 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.080892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.080893 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.081005 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:56.081062 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:56.081327 (+ 265us) server_negotiation.cc:299] Negotiation successful
0810 14:50:56.081412 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":786,"thread_start_us":90,"threads_started":1}
I20260810 14:50:56.081660 8020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.070441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.193:40711)
0810 14:50:56.070612 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:56.070654 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:56.071119 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:56.071466 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:56.071470 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:56.071643 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:56.071824 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.071828 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.072500 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.072501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.073280 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.073283 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.073799 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.073801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.073923 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.074972 (+ 1049us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:56.074982 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:56.078322 (+ 3340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:56.080198 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.080205 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.080208 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.080486 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.080714 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.080715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.080716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.080828 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.081064 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:56.081072 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:56.081207 (+ 135us) client_negotiation.cc:769] Sending connection context
0810 14:50:56.081299 (+ 92us) client_negotiation.cc:240] Negotiation successful
0810 14:50:56.081442 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260810 14:50:56.082165 8018 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:56.082262 8018 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:56.082456 8018 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:56.082976 7623 ts_manager.cc:194] Registered new tserver with Master: 0cc39073db9045ce8cf8104604a45389 (127.19.29.193:38637)
I20260810 14:50:56.083568 7623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:40711
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:50:56.106212 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:56.205299 8027 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:56.205626 8027 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:56.205682 8027 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:56.207142 8027 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:56.207190 8027 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:56.207226 8027 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:50:56.208735 8027 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:56.208962 8027 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:56.209319 8027 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:56.214567 8047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.214563 8044 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.214910 8042 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:56.215433 8027 server_base.cc:1034] running on GCE node
I20260810 14:50:56.215618 8027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:56.215894 8027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:56.217038 8027 hybrid_clock.cc:648] HybridClock initialized: now 1786373456217019 us; error 35 us; skew 500 ppm
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:56.219571 8027 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:50:56.220139 8027 webserver.cc:460] Webserver started at http://127.19.29.194:45659/ using document root <none> and password file <none>
I20260810 14:50:56.220393 8027 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:56.220455 8027 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:56.220588 8027 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:56.238241 8027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "4bdffdd195a94b91b815929703389dd0"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "1eef9a2eca88ed86159de3085dd4584d"
server_key_iv: "0f69c5b55795821b6f3e305efd9650c9"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.238659 8027 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "4bdffdd195a94b91b815929703389dd0"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "1eef9a2eca88ed86159de3085dd4584d"
server_key_iv: "0f69c5b55795821b6f3e305efd9650c9"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.243824 8027 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.001s
I20260810 14:50:56.265377 8062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.265609 8027 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.000s
I20260810 14:50:56.265698 8027 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "4bdffdd195a94b91b815929703389dd0"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "1eef9a2eca88ed86159de3085dd4584d"
server_key_iv: "0f69c5b55795821b6f3e305efd9650c9"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.265784 8027 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:56.296901 8027 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:56.299292 8027 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:56.299429 8027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:56.299664 8027 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:56.299984 8027 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:56.300020 8027 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.300050 8027 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:56.300073 8027 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.305773 8027 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34657
I20260810 14:50:56.306270 8027 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:50:56.308969 8259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34657 every 8 connection(s)
I20260810 14:50:56.310974 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 8027
I20260810 14:50:56.311089 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:50:56.311287 19575 external_mini_cluster.cc:1428] Setting key 34c5b004e0a2c7ac3fb7c92277fe7267
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:56.321045 8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.310502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:51215 (local address 127.19.29.254:42805)
0810 14:50:56.310549 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:56.310551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:56.310893 (+ 342us) server_negotiation.cc:407] Connection header received
0810 14:50:56.311808 (+ 915us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:56.311809 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:56.311826 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:56.311855 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:56.312696 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.313455 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.314936 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.315247 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.315292 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.317864 (+ 2572us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:56.317865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:56.317865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:56.317872 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:56.319518 (+ 1646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.319970 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.319972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.319972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.320030 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.320306 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.320307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.320307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.320431 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:56.320487 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:56.320858 (+ 371us) server_negotiation.cc:299] Negotiation successful
0810 14:50:56.320948 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:56.321820 8265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.310184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.194:51215)
0810 14:50:56.310755 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:56.310802 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:56.311683 (+ 881us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:56.312041 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:56.312045 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:56.312303 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:56.312587 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.312593 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.313579 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.313580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.314836 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.314839 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.315396 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.315397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.315560 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.316128 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:56.316138 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:56.317758 (+ 1620us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:56.319609 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.319616 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.319618 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.319884 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.320095 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.320096 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.320096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.320233 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.320538 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:56.320544 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:56.320702 (+ 158us) client_negotiation.cc:769] Sending connection context
0810 14:50:56.321380 (+ 678us) client_negotiation.cc:240] Negotiation successful
0810 14:50:56.321554 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":111,"threads_started":1}
I20260810 14:50:56.322600 8260 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:56.322695 8260 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:56.322878 8260 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:56.323279 7623 ts_manager.cc:194] Registered new tserver with Master: 4bdffdd195a94b91b815929703389dd0 (127.19.29.194:34657)
I20260810 14:50:56.323786 7623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:51215
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:50:56.357065 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:56.480427 8268 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:56.480768 8268 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:56.480845 8268 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:56.482517 8268 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:56.482618 8268 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:56.482693 8268 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:50:56.484763 8268 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8268
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:56.485180 8268 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:56.485509 8268 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:56.491758 8281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.492048 8274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.492251 8286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:56.493158 8268 server_base.cc:1034] running on GCE node
I20260810 14:50:56.493462 8268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:56.493718 8268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:56.494858 8268 hybrid_clock.cc:648] HybridClock initialized: now 1786373456494830 us; error 47 us; skew 500 ppm
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:56.497856 8268 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:50:56.498317 8268 webserver.cc:460] Webserver started at http://127.19.29.195:45957/ using document root <none> and password file <none>
I20260810 14:50:56.498560 8268 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:56.498616 8268 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:50:56.498780 8268 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:56.515794 8268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "901d7e85d5914e5cb49f5df755f519ae"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "92eee81d10999e9499207a5026fbffca"
server_key_iv: "fef69338bb614333f4ff715cb85b41d2"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.516331 8268 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "901d7e85d5914e5cb49f5df755f519ae"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "92eee81d10999e9499207a5026fbffca"
server_key_iv: "fef69338bb614333f4ff715cb85b41d2"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.518682 8268 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260810 14:50:56.533835 8303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.534109 8268 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:56.534231 8268 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "901d7e85d5914e5cb49f5df755f519ae"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "92eee81d10999e9499207a5026fbffca"
server_key_iv: "fef69338bb614333f4ff715cb85b41d2"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.534364 8268 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:56.569337 8268 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:56.571955 8268 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:56.572160 8268 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:56.572469 8268 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:56.572909 8268 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:56.573000 8268 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.573072 8268 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:56.573129 8268 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.580137 8268 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:39543
I20260810 14:50:56.580633 8268 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:50:56.582433 8486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:39543 every 8 connection(s)
I20260810 14:50:56.590023 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 8268
I20260810 14:50:56.590133 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:56.590344 19575 external_mini_cluster.cc:1428] Setting key b8c4c2373ab3b4beb30a507a0cd1d5e0
I20260810 14:50:56.594755 8022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.583759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:55945 (local address 127.19.29.254:42805)
0810 14:50:56.583804 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:56.583806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:56.584025 (+ 219us) server_negotiation.cc:407] Connection header received
0810 14:50:56.584754 (+ 729us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:56.584757 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:56.584770 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:56.584801 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:56.585651 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.586455 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.587950 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.588232 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.588281 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.591512 (+ 3231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:56.591513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:56.591514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:56.591523 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:56.593162 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.593662 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.593664 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.593664 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.593725 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:56.593998 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:56.594000 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:56.594000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:56.594129 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:56.594174 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:56.594567 (+ 393us) server_negotiation.cc:299] Negotiation successful
0810 14:50:56.594660 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:56.595659 8492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:56.583429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.195:55945)
0810 14:50:56.583898 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:56.583945 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:56.584619 (+ 674us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:56.584987 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:56.584993 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:56.585251 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:56.585524 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.585530 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.586585 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.586586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.587846 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:56.587849 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:56.588388 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:56.588389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:56.588529 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:56.589103 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:56.589113 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:56.591406 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:56.593262 (+ 1856us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.593270 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.593272 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.593554 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.593793 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:56.593794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:56.593794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:56.593921 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:56.594224 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:56.594230 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:56.594414 (+ 184us) client_negotiation.cc:769] Sending connection context
0810 14:50:56.595257 (+ 843us) client_negotiation.cc:240] Negotiation successful
0810 14:50:56.595417 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":429,"thread_start_us":84,"threads_started":1}
I20260810 14:50:56.596298 8487 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:56.596383 8487 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:56.596556 8487 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:56.596974 7623 ts_manager.cc:194] Registered new tserver with Master: 901d7e85d5914e5cb49f5df755f519ae (127.19.29.195:39543)
I20260810 14:50:56.597468 7623 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:55945
I20260810 14:50:56.601822 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:50:56.602615 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 7765
I20260810 14:50:56.712718 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 8027
I20260810 14:50:56.751312 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 8268
I20260810 14:50:56.758709 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 7572
I20260810 14:50:56.771796 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:42805
--webserver_interface=127.19.29.254
--webserver_port=35513
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:42805
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:50:56.853782 8493 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:56.853976 8493 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:56.854003 8493 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:56.855159 8493 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:50:56.855202 8493 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:56.855221 8493 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:56.855237 8493 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:50:56.855259 8493 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:50:56.856796 8493 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:42805
--ranger_config_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:42805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=35513
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8493
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:56.857024 8493 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:56.857232 8493 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:56.861784 8506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.861794 8502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:56.861793 8504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:56.861820 8493 server_base.cc:1034] running on GCE node
I20260810 14:50:56.862200 8493 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:56.862480 8493 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:56.863620 8493 hybrid_clock.cc:648] HybridClock initialized: now 1786373456863607 us; error 25 us; skew 500 ppm
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:56.865831 8493 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:50:56.866225 8493 webserver.cc:460] Webserver started at http://127.19.29.254:35513/ using document root <none> and password file <none>
I20260810 14:50:56.866425 8493 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:56.866480 8493 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:50:56 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373456, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:56.907827 8493 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:56.908632 8520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:56.908810 8493 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:56.908910 8493 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "b06fb4971d7c40f8953a2013f0b234d9"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "3853e5a6ead8abae60afa7a64f8b019c"
server_key_iv: "648b1bb4f92a645aa5868f52d6f6d31f"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:56.909277 8493 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:56.925129 8493 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:56.927330 8493 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:56.927484 8493 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:56.932523 8493 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:42805
I20260810 14:50:56.932560 8602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:42805 every 8 connection(s)
I20260810 14:50:56.932924 8493 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:50:56.934139 8603 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:50:56.934829 8603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Bootstrap starting.
I20260810 14:50:56.938220 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 8493
I20260810 14:50:56.938565 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:38637
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:42805
--webserver_port=43303
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:50:56.943136 8603 log.cc:824] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:56.944736 8603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:50:56.944973 8603 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Bootstrap complete.
I20260810 14:50:56.947192 8603 raft_consensus.cc:348] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:56.947418 8603 raft_consensus.cc:729] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b06fb4971d7c40f8953a2013f0b234d9, State: Initialized, Role: FOLLOWER
I20260810 14:50:56.947567 8603 consensus_queue.cc:260] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:56.947629 8603 raft_consensus.cc:388] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:50:56.947657 8603 raft_consensus.cc:482] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:50:56.947702 8603 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:50:56.948637 8603 raft_consensus.cc:504] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:56.948722 8603 leader_election.cc:302] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b06fb4971d7c40f8953a2013f0b234d9; no voters:
I20260810 14:50:56.948879 8603 leader_election.cc:288] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:50:56.948928 8610 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:50:56.949074 8610 raft_consensus.cc:686] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [term 2 LEADER]: Becoming Leader. State: Replica: b06fb4971d7c40f8953a2013f0b234d9, State: Running, Role: LEADER
I20260810 14:50:56.949136 8603 sys_catalog.cc:564] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:50:56.949239 8610 consensus_queue.cc:237] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } }
I20260810 14:50:56.949558 8613 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b06fb4971d7c40f8953a2013f0b234d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } } }
I20260810 14:50:56.949635 8613 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:50:56.949791 8615 sys_catalog.cc:455] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b06fb4971d7c40f8953a2013f0b234d9. Latest consensus state: current_term: 2 leader_uuid: "b06fb4971d7c40f8953a2013f0b234d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b06fb4971d7c40f8953a2013f0b234d9" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 42805 } } }
I20260810 14:50:56.949875 8615 sys_catalog.cc:458] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:50:56.950030 8624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:50:56.950555 8624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:50:56.950730 8624 catalog_manager.cc:1259] Loaded cluster ID: 0183d89e81724632a1cb3e9db3af6411
I20260810 14:50:56.950814 8624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:50:56.950866 8603 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260810 14:50:56.952003 8624 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:50:56.952201 8624 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Loaded TSK: 0
I20260810 14:50:56.952415 8624 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:50:57.045733 8608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:57.046000 8608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:57.046036 8608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:57.047690 8608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:57.047780 8608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:57.047839 8608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:50:57.049939 8608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:38637
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=43303
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:57.050416 8608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:57.050705 8608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:57.057145 8658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:57.057150 8662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:57.057505 8659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:57.058027 8608 server_base.cc:1034] running on GCE node
I20260810 14:50:57.058255 8608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:57.058591 8608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:57.059760 8608 hybrid_clock.cc:648] HybridClock initialized: now 1786373457059746 us; error 28 us; skew 500 ppm
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:57.063135 8608 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:50:57.063762 8608 webserver.cc:460] Webserver started at http://127.19.29.193:43303/ using document root <none> and password file <none>
I20260810 14:50:57.064100 8608 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:57.064248 8608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:57.081568 8608 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260810 14:50:57.083021 8672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.083240 8608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:50:57.083319 8608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "0cc39073db9045ce8cf8104604a45389"
format_stamp: "Formatted at 2026-08-10 14:50:55 on dist-test-slave-4tdj"
server_key: "d6e3d41b91b6e770369f4619fc56fde3"
server_key_iv: "94209cb9355d129fd24667e790188438"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:57.083786 8608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:57.101267 8608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:57.103274 8608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:57.103417 8608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:57.103632 8608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:57.104008 8608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:57.104053 8608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.104085 8608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:57.104125 8608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.110767 8608 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:38637
I20260810 14:50:57.110937 8873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:38637 every 8 connection(s)
I20260810 14:50:57.111238 8608 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:57.120370 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 8608
I20260810 14:50:57.120689 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:34657
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:42805
--webserver_port=45659
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:50:57.122151 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.112081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:39499 (local address 127.19.29.254:42805)
0810 14:50:57.112318 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:57.112328 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:57.112365 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:50:57.112954 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:57.112960 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:57.113009 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:57.113127 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:57.113744 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.114655 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.115608 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.116013 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.116116 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.118324 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:57.118329 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:57.118329 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:57.118341 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:57.120350 (+ 2009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.120787 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.120790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.120791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.120896 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.121168 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.121169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.121170 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.121476 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:57.121561 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:57.121860 (+ 299us) server_negotiation.cc:299] Negotiation successful
0810 14:50:57.121982 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":96,"threads_started":1}
I20260810 14:50:57.122164 8880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.111916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.193:39499)
0810 14:50:57.112169 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:57.112212 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:57.112729 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:57.113208 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:57.113212 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:57.113423 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:57.113615 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.113619 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.114750 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.114751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.115527 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.115529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.116108 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.116109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.116228 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.116683 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:57.116692 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:57.118159 (+ 1467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:57.120444 (+ 2285us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.120451 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.120453 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.120695 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.120966 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.120967 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.120968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.121095 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.121589 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:57.121595 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:57.121701 (+ 106us) client_negotiation.cc:769] Sending connection context
0810 14:50:57.121788 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:50:57.121939 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":90,"threads_started":1}
I20260810 14:50:57.123302 8876 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:57.125959 8876 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.126168 8876 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.126986 8876 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:42805 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:50:57.127049 8876 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.127127 8876 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:57.127430 8876 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.127503 8876 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.127802 8876 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:50:57.241495 8882 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:57.241777 8882 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:57.241823 8882 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:57.243453 8882 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:57.243574 8882 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:57.243650 8882 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:50:57.245775 8882 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:34657
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=45659
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8882
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:57.246230 8882 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:57.246589 8882 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:57.251945 8894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:57.251979 8889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:57.252256 8882 server_base.cc:1034] running on GCE node
W20260810 14:50:57.254449 8891 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:57.254673 8882 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:57.254920 8882 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:57.256108 8882 hybrid_clock.cc:648] HybridClock initialized: now 1786373457256086 us; error 34 us; skew 500 ppm
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:57.259654 8882 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:50:57.260234 8882 webserver.cc:460] Webserver started at http://127.19.29.194:45659/ using document root <none> and password file <none>
I20260810 14:50:57.260556 8882 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:57.260715 8882 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:57.272851 8882 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:57.274744 8907 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.274938 8882 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260810 14:50:57.275012 8882 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "4bdffdd195a94b91b815929703389dd0"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "1eef9a2eca88ed86159de3085dd4584d"
server_key_iv: "0f69c5b55795821b6f3e305efd9650c9"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:57.275437 8882 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:57.287240 8882 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:57.289301 8882 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:57.289430 8882 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:57.289624 8882 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:57.289937 8882 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:57.289975 8882 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.290001 8882 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:57.290057 8882 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.296741 8882 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:34657
I20260810 14:50:57.297262 8882 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:50:57.297763 9106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:34657 every 8 connection(s)
I20260810 14:50:57.298015 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 8882
I20260810 14:50:57.298338 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.19.29.212:33905/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:39543
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:42805
--webserver_port=45957
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:57.309533 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.300275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:49207 (local address 127.19.29.254:42805)
0810 14:50:57.300321 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:57.300323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:57.300332 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:50:57.300357 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:57.300358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:57.300366 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:57.300419 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:57.301135 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.301880 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.303342 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.303660 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.303709 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.306232 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:57.306234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:57.306234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:57.306242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:57.307913 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.308406 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.308408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.308409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.308471 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.308773 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.308774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.308774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.308913 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:57.308957 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:57.309342 (+ 385us) server_negotiation.cc:299] Negotiation successful
0810 14:50:57.309435 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:57.310178 9109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.298092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.194:49207)
0810 14:50:57.298246 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:57.298285 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:57.298840 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:57.300518 (+ 1678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:57.300523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:57.300741 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:57.301011 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.301017 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.301990 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.301991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.303232 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.303236 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.303823 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.303824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.303959 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.304497 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:57.304508 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:57.306114 (+ 1606us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:57.308012 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.308019 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.308021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.308309 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.308557 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.308557 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.308558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.308693 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.309005 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:57.309011 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:57.309176 (+ 165us) client_negotiation.cc:769] Sending connection context
0810 14:50:57.309781 (+ 605us) client_negotiation.cc:240] Negotiation successful
0810 14:50:57.309946 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260810 14:50:57.310770 9107 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:57.310859 9107 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.311033 9107 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.311684 9107 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:42805 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:50:57.311748 9107 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.311806 9107 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:57.312144 9107 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.312211 9107 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.312599 9107 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:50:57.387732 9110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:50:57.388074 9110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:50:57.388131 9110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:50:57.389683 9110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:50:57.389786 9110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:50:57.389868 9110 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:50:57.391968 9110 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.19.29.212:33905/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:39543
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=45957
--tserver_master_addrs=127.19.29.254:42805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:50:57.392407 9110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:50:57.392710 9110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:50:57.399150 9119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:57.399605 9128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:50:57.400252 9118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:50:57.400359 9110 server_base.cc:1034] running on GCE node
I20260810 14:50:57.400658 9110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:50:57.400928 9110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:50:57.402105 9110 hybrid_clock.cc:648] HybridClock initialized: now 1786373457402085 us; error 32 us; skew 500 ppm
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:57.405303 9110 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:50:57.405804 9110 webserver.cc:460] Webserver started at http://127.19.29.195:45957/ using document root <none> and password file <none>
I20260810 14:50:57.406071 9110 fs_manager.cc:359] Metadata directory not provided
I20260810 14:50:57.406150 9110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:57.426235 9110 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:50:57.427052 9140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.427330 9110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:50:57.427438 9110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "901d7e85d5914e5cb49f5df755f519ae"
format_stamp: "Formatted at 2026-08-10 14:50:56 on dist-test-slave-4tdj"
server_key: "92eee81d10999e9499207a5026fbffca"
server_key_iv: "fef69338bb614333f4ff715cb85b41d2"
server_key_version: "kuduclusterkey@0"
I20260810 14:50:57.427887 9110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:50:57.454648 9110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:50:57.459290 9110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:50:57.459506 9110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:50:57.459794 9110 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:50:57.460217 9110 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:50:57.460299 9110 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.460361 9110 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:50:57.460405 9110 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:50:57.466681 9110 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:39543
I20260810 14:50:57.467217 9110 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:50:57.471405 9332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:39543 every 8 connection(s)
I20260810 14:50:57.475142 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 9110
Aug 10 14:50:57 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373457, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:50:57.480093 8881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.471777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:57633 (local address 127.19.29.254:42805)
0810 14:50:57.471825 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:57.471827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:57.472029 (+ 202us) server_negotiation.cc:407] Connection header received
0810 14:50:57.472525 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:57.472527 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:57.472541 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:57.472592 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:57.473156 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.473637 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.474656 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.474842 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.474897 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.477206 (+ 2309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:57.477208 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:57.477208 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:57.477215 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:57.478570 (+ 1355us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.479051 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.479053 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.479053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.479113 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.479383 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.479384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.479384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.479510 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:57.479551 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:57.479908 (+ 357us) server_negotiation.cc:299] Negotiation successful
0810 14:50:57.479991 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:57.480238 9336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.471669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:42805 (local address 127.19.29.195:57633)
0810 14:50:57.471898 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:57.471936 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:57.472421 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:57.472666 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:57.472670 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:57.472855 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:50:57.473064 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.473068 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.473718 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.473719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.474577 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:57.474579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.474927 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.474929 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:57.475048 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.475563 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:50:57.475574 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:50:57.477101 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:50:57.478651 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.478659 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.478661 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.478948 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.479183 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:50:57.479184 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:50:57.479184 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:50:57.479312 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:50:57.479597 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:50:57.479603 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:50:57.479757 (+ 154us) client_negotiation.cc:769] Sending connection context
0810 14:50:57.479863 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 14:50:57.480018 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":79,"threads_started":1}
I20260810 14:50:57.482522 9333 heartbeater.cc:347] Connected to a master server at 127.19.29.254:42805
I20260810 14:50:57.482628 9333 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.482803 9333 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.483404 9333 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:42805 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260810 14:50:57.483470 9333 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.483536 9333 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:57.483841 9333 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:57.483915 9333 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
W20260810 14:50:57.484193 9333 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:50:57.491390 9338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:57.475546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56974 (local address 127.19.29.254:42805)
0810 14:50:57.475665 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:57.475667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:57.475806 (+ 139us) server_negotiation.cc:407] Connection header received
0810 14:50:57.475879 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:57.475880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:57.475891 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:57.475952 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:57.476772 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.477692 (+ 920us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.482199 (+ 4507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:57.482457 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:57.482529 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:57.486510 (+ 3981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:57.486512 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:57.486512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:57.486519 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:57.488131 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.490648 (+ 2517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.490649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.490650 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.490704 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:57.490895 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:57.490896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:57.490896 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:57.491022 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:57.491178 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:57.491221 (+ 43us) server_negotiation.cc:299] Negotiation successful
0810 14:50:57.491293 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
Aug 10 14:50:58 dist-test-slave-4tdj krb5kdc[6794](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786373458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:50:58.127986 8876 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:58.128142 8876 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:58.128593 8547 ts_manager.cc:194] Registered new tserver with Master: 0cc39073db9045ce8cf8104604a45389 (127.19.29.193:38637)
I20260810 14:50:58.129594 8547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:39499
I20260810 14:50:58.312819 9107 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:58.312980 9107 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:58.313364 8547 ts_manager.cc:194] Registered new tserver with Master: 4bdffdd195a94b91b815929703389dd0 (127.19.29.194:34657)
I20260810 14:50:58.313923 8547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:49207
Aug 10 14:50:58 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:58.484381 9333 heartbeater.cc:464] Registering TS with master...
I20260810 14:50:58.484534 9333 heartbeater.cc:511] Master 127.19.29.254:42805 requested a full tablet report, sending...
I20260810 14:50:58.484946 8547 ts_manager.cc:194] Registered new tserver with Master: 901d7e85d5914e5cb49f5df755f519ae (127.19.29.195:39543)
I20260810 14:50:58.485474 8547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:57633
I20260810 14:50:58.486948 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:50:58.496090 9375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.488195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56412 (local address 127.19.29.254:42805)
0810 14:50:58.488500 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.488502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.488509 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:50:58.488530 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.488531 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.488542 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.489274 (+ 732us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:50:58.489310 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.490089 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.491106 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.491403 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.491739 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.492872 (+ 1133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:50:58.492874 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:50:58.492874 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:50:58.492881 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:50:58.494620 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:58.494999 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:58.495000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:58.495000 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:58.495055 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:50:58.495239 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:50:58.495240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:50:58.495240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:50:58.495363 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:50:58.495871 (+ 508us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.495913 (+ 42us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.495994 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":286,"thread_start_us":60,"threads_started":1}
I20260810 14:50:58.498416 8547 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56412:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:50:58.500783 8547 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:50:58.515992 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:34657 (local address 127.0.0.1:40744)
0810 14:50:58.510452 (+ 6357us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.510514 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:58.510603 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:58.511102 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:58.511106 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:58.511108 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:58.511185 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.511187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.512851 (+ 1664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.512852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.514234 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.514237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.515660 (+ 1423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.515661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.515757 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.515771 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:50:58.515843 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 14:50:58.515900 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6314,"thread_start_us":94,"threads_started":1}
I20260810 14:50:58.516713 9392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40744 (local address 127.19.29.194:34657)
0810 14:50:58.504836 (+ 324us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.504841 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.510698 (+ 5857us) server_negotiation.cc:407] Connection header received
0810 14:50:58.510742 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.510745 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.510763 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.510833 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:58.511266 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.512759 (+ 1493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.514347 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.515465 (+ 1118us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.515536 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.515619 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.516593 (+ 974us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.516636 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":66,"threads_started":1}
I20260810 14:50:58.517668 8958 tablet_service.cc:1467] Processing CreateTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 (DEFAULT_TABLE table=test-table [id=05771e606c784e849359685e1baae0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:58.518091 8958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eefa4001e054d719bdcf075af0c61f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:58.525269 9393 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Bootstrap starting.
I20260810 14:50:58.526053 9393 tablet_bootstrap.cc:654] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:58.526461 9393 log.cc:824] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:58.527086 9385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:38637 (local address 127.0.0.1:44012)
0810 14:50:58.516451 (+ 12129us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.516460 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:58.516508 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:58.517246 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:58.517247 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:58.517249 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:58.517284 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.517285 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.523274 (+ 5989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.523276 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.524403 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.524407 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.526864 (+ 2457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.526866 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.526924 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.526928 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:58.526966 (+ 38us) client_negotiation.cc:240] Negotiation successful
0810 14:50:58.527008 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12118,"thread_start_us":62,"threads_started":1}
I20260810 14:50:58.527103 9391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44012 (local address 127.19.29.193:38637)
0810 14:50:58.510399 (+ 5968us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.510405 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.516520 (+ 6115us) server_negotiation.cc:407] Connection header received
0810 14:50:58.516570 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.516573 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.516591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.516688 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:58.522014 (+ 5326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.523166 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.524517 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.525308 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.526873 (+ 1565us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.526949 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.526981 (+ 32us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.527024 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5924,"thread_start_us":60,"threads_started":1}
I20260810 14:50:58.527804 9393 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: No bootstrap required, opened a new log
I20260810 14:50:58.527884 9393 ts_tablet_manager.cc:1397] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260810 14:50:58.528028 8763 tablet_service.cc:1467] Processing CreateTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 (DEFAULT_TABLE table=test-table [id=05771e606c784e849359685e1baae0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:58.528416 8763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eefa4001e054d719bdcf075af0c61f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:58.528918 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:39543 (local address 127.0.0.1:43034)
0810 14:50:58.510957 (+ 6838us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.510968 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:58.511033 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:58.517071 (+ 6038us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:58.517072 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:58.517075 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:58.517128 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.517130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.525452 (+ 8322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.525454 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.526691 (+ 1237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.526694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.528686 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.528687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.528764 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.528768 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:50:58.528804 (+ 36us) client_negotiation.cc:240] Negotiation successful
0810 14:50:58.528842 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6819,"thread_start_us":70,"threads_started":1}
I20260810 14:50:58.529181 9387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.504224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43034 (local address 127.19.29.195:39543)
0810 14:50:58.516846 (+ 12622us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.516851 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.516861 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:50:58.516893 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.516894 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.516910 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.516981 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:58.523545 (+ 6564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.525040 (+ 1495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.526799 (+ 1759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.528517 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.528595 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.528650 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.529056 (+ 406us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.529099 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12581,"thread_start_us":61,"threads_started":1}
I20260810 14:50:58.529731 9207 tablet_service.cc:1467] Processing CreateTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 (DEFAULT_TABLE table=test-table [id=05771e606c784e849359685e1baae0cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:50:58.529990 9207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eefa4001e054d719bdcf075af0c61f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:50:58.530011 9393 raft_consensus.cc:348] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.530174 9393 raft_consensus.cc:374] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:58.530207 9393 raft_consensus.cc:729] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bdffdd195a94b91b815929703389dd0, State: Initialized, Role: FOLLOWER
I20260810 14:50:58.530383 9393 consensus_queue.cc:260] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.530711 9393 ts_tablet_manager.cc:1428] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260810 14:50:58.530926 9107 heartbeater.cc:503] Master 127.19.29.254:42805 was elected leader, sending a full tablet report...
I20260810 14:50:58.532720 9402 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Bootstrap starting.
I20260810 14:50:58.533317 9408 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Bootstrap starting.
I20260810 14:50:58.533420 9402 tablet_bootstrap.cc:654] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:58.533785 9402 log.cc:824] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:58.534080 9408 tablet_bootstrap.cc:654] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Neither blocks nor log segments found. Creating new log.
I20260810 14:50:58.534373 9408 log.cc:824] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Log is configured to *not* fsync() on all Append() calls
I20260810 14:50:58.535048 9408 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: No bootstrap required, opened a new log
I20260810 14:50:58.535108 9408 ts_tablet_manager.cc:1397] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:50:58.536628 9408 raft_consensus.cc:348] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.536744 9408 raft_consensus.cc:374] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:58.536764 9408 raft_consensus.cc:729] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 901d7e85d5914e5cb49f5df755f519ae, State: Initialized, Role: FOLLOWER
I20260810 14:50:58.536855 9408 consensus_queue.cc:260] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.537094 9408 ts_tablet_manager.cc:1428] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:50:58.537118 9333 heartbeater.cc:503] Master 127.19.29.254:42805 was elected leader, sending a full tablet report...
I20260810 14:50:58.537619 9402 tablet_bootstrap.cc:492] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: No bootstrap required, opened a new log
I20260810 14:50:58.537688 9402 ts_tablet_manager.cc:1397] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 14:50:58.539716 9402 raft_consensus.cc:348] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.539827 9402 raft_consensus.cc:374] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:50:58.539845 9402 raft_consensus.cc:729] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cc39073db9045ce8cf8104604a45389, State: Initialized, Role: FOLLOWER
I20260810 14:50:58.539935 9402 consensus_queue.cc:260] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.540164 9402 ts_tablet_manager.cc:1428] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:50:58.540189 8876 heartbeater.cc:503] Master 127.19.29.254:42805 was elected leader, sending a full tablet report...
W20260810 14:50:58.548417 9108 tablet.cc:2369] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:50:58.612591 8879 tablet.cc:2369] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:50:58.642478 9417 raft_consensus.cc:482] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:50:58.642633 9417 raft_consensus.cc:504] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.643038 9417 leader_election.cc:288] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bdffdd195a94b91b815929703389dd0 (127.19.29.194:34657), 901d7e85d5914e5cb49f5df755f519ae (127.19.29.195:39543)
I20260810 14:50:58.648320 9392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.644032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:37265 (local address 127.19.29.194:34657)
0810 14:50:58.644077 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.644079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.644353 (+ 274us) server_negotiation.cc:407] Connection header received
0810 14:50:58.644442 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.644443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.644452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.644479 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:58.644697 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.645445 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.647315 (+ 1870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.647867 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.647909 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.647918 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.648203 (+ 285us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.648251 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:58.648746 9422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.643806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:34657 (local address 127.19.29.193:37265)
0810 14:50:58.644304 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.644312 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:58.644375 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:58.644542 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:58.644543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:58.644545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:58.644623 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.644624 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.645535 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.645535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.647226 (+ 1691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.647229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.648026 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.648027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.648111 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.648116 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:50:58.648605 (+ 489us) client_negotiation.cc:240] Negotiation successful
0810 14:50:58.648648 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":86,"threads_started":1}
I20260810 14:50:58.649251 9025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eefa4001e054d719bdcf075af0c61f8" candidate_uuid: "0cc39073db9045ce8cf8104604a45389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bdffdd195a94b91b815929703389dd0" is_pre_election: true
I20260810 14:50:58.649433 9025 raft_consensus.cc:2454] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc39073db9045ce8cf8104604a45389 in term 0.
I20260810 14:50:58.649806 8685 leader_election.cc:302] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc39073db9045ce8cf8104604a45389, 4bdffdd195a94b91b815929703389dd0; no voters:
I20260810 14:50:58.649930 9417 raft_consensus.cc:2781] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:50:58.649966 9417 raft_consensus.cc:482] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:50:58.649986 9417 raft_consensus.cc:3037] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:58.650262 9387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.644198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:58517 (local address 127.19.29.195:39543)
0810 14:50:58.644240 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.644242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.644249 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:50:58.644278 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.644279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.644289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.644339 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:50:58.644947 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.645627 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.649192 (+ 3565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.649811 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.649860 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.649868 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.650134 (+ 266us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.650196 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:50:58.650496 9421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.643333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:39543 (local address 127.19.29.193:58517)
0810 14:50:58.644142 (+ 809us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.644154 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:50:58.644214 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:50:58.644799 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:50:58.644800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:50:58.644802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:50:58.644863 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.644865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.646149 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.646149 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.647774 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:50:58.647777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.649965 (+ 2188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.649967 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:50:58.650053 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.650056 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:50:58.650373 (+ 317us) client_negotiation.cc:240] Negotiation successful
0810 14:50:58.650420 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":790,"thread_start_us":95,"threads_started":1}
I20260810 14:50:58.650792 9229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eefa4001e054d719bdcf075af0c61f8" candidate_uuid: "0cc39073db9045ce8cf8104604a45389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "901d7e85d5914e5cb49f5df755f519ae" is_pre_election: true
I20260810 14:50:58.650902 9417 raft_consensus.cc:504] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.650942 9229 raft_consensus.cc:2454] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cc39073db9045ce8cf8104604a45389 in term 0.
I20260810 14:50:58.651036 9417 leader_election.cc:288] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [CANDIDATE]: Term 1 election: Requested vote from peers 4bdffdd195a94b91b815929703389dd0 (127.19.29.194:34657), 901d7e85d5914e5cb49f5df755f519ae (127.19.29.195:39543)
I20260810 14:50:58.651208 9229 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eefa4001e054d719bdcf075af0c61f8" candidate_uuid: "0cc39073db9045ce8cf8104604a45389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "901d7e85d5914e5cb49f5df755f519ae"
I20260810 14:50:58.651281 9229 raft_consensus.cc:3037] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:58.651283 9025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eefa4001e054d719bdcf075af0c61f8" candidate_uuid: "0cc39073db9045ce8cf8104604a45389" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bdffdd195a94b91b815929703389dd0"
I20260810 14:50:58.651350 9025 raft_consensus.cc:3037] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:50:58.652144 9229 raft_consensus.cc:2454] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc39073db9045ce8cf8104604a45389 in term 1.
I20260810 14:50:58.652196 9025 raft_consensus.cc:2454] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cc39073db9045ce8cf8104604a45389 in term 1.
I20260810 14:50:58.652330 8674 leader_election.cc:302] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cc39073db9045ce8cf8104604a45389, 901d7e85d5914e5cb49f5df755f519ae; no voters:
I20260810 14:50:58.652408 9417 raft_consensus.cc:2781] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:50:58.652547 9417 raft_consensus.cc:686] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [term 1 LEADER]: Becoming Leader. State: Replica: 0cc39073db9045ce8cf8104604a45389, State: Running, Role: LEADER
I20260810 14:50:58.652634 9417 consensus_queue.cc:237] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } }
I20260810 14:50:58.653463 8547 catalog_manager.cc:5495] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cc39073db9045ce8cf8104604a45389 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "0cc39073db9045ce8cf8104604a45389" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0cc39073db9045ce8cf8104604a45389" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 38637 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 } health_report { overall_health: UNKNOWN } } }
Aug 10 14:50:58 dist-test-slave-4tdj krb5kdc[6794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373458, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for HTTP/127.19.29.212@KRBTEST.COM
I20260810 14:50:58.689714 9391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.685224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44018 (local address 127.19.29.193:38637)
0810 14:50:58.685269 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:50:58.685271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:50:58.685279 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:50:58.685321 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:50:58.685321 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:50:58.685344 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:50:58.685408 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:50:58.685605 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.686310 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.688613 (+ 2303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:50:58.688888 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:50:58.688948 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:50:58.689167 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:50:58.689312 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:50:58.689384 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:50:58.689610 (+ 226us) server_negotiation.cc:299] Negotiation successful
0810 14:50:58.689634 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:50:58.694765 9229 raft_consensus.cc:1261] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 1 FOLLOWER]: Refusing update from remote peer 0cc39073db9045ce8cf8104604a45389: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:50:58.695153 9025 raft_consensus.cc:1261] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 1 FOLLOWER]: Refusing update from remote peer 0cc39073db9045ce8cf8104604a45389: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:50:58.695660 9417 consensus_queue.cc:1035] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bdffdd195a94b91b815929703389dd0" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 34657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:50:58.696157 9417 consensus_queue.cc:1035] T 7eefa4001e054d719bdcf075af0c61f8 P 0cc39073db9045ce8cf8104604a45389 [LEADER]: Connected to new peer: Peer: permanent_uuid: "901d7e85d5914e5cb49f5df755f519ae" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 39543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:50:58.701061 9435 mvcc.cc:205] Tried to move back new op lower bound from 7316985686809825280 to 7316985686641774592. Current Snapshot: MvccSnapshot[applied={T|T < 7316985686809825280}]
I20260810 14:50:58.700814 9429 mvcc.cc:205] Tried to move back new op lower bound from 7316985686809825280 to 7316985686641774592. Current Snapshot: MvccSnapshot[applied={T|T < 7316985686809825280}]
I20260810 14:50:58.702189 9431 mvcc.cc:205] Tried to move back new op lower bound from 7316985686809825280 to 7316985686641774592. Current Snapshot: MvccSnapshot[applied={T|T < 7316985686809825280}]
I20260810 14:50:58.706923 8547 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:50:58.707017 8547 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56412:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:50:58.707840 8547 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b06fb4971d7c40f8953a2013f0b234d9: Sending DeleteTablet for 3 replicas of tablet 7eefa4001e054d719bdcf075af0c61f8
I20260810 14:50:58.708316 8958 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:58 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40744
I20260810 14:50:58.708549 9207 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:58 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43034
I20260810 14:50:58.709086 8763 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eefa4001e054d719bdcf075af0c61f8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:50:58 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:44012
I20260810 14:50:58.709506 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 8608
I20260810 14:50:58.722536 9452 tablet_replica.cc:330] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: stopping tablet replica
I20260810 14:50:58.722726 9451 tablet_replica.cc:330] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: stopping tablet replica
I20260810 14:50:58.722904 9451 raft_consensus.cc:2229] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:50:58.723026 9452 raft_consensus.cc:2229] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:50:58.723196 9451 raft_consensus.cc:2258] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:50:58.723325 9452 raft_consensus.cc:2258] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:50:58.723970 9451 ts_tablet_manager.cc:1905] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:50:58.725875 9451 ts_tablet_manager.cc:1918] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:50:58.725983 9451 log.cc:1196] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/7eefa4001e054d719bdcf075af0c61f8
I20260810 14:50:58.726276 9451 ts_tablet_manager.cc:1939] T 7eefa4001e054d719bdcf075af0c61f8 P 4bdffdd195a94b91b815929703389dd0: Deleting consensus metadata
I20260810 14:50:58.727604 8523 catalog_manager.cc:4841] TS 4bdffdd195a94b91b815929703389dd0 (127.19.29.194:34657): tablet 7eefa4001e054d719bdcf075af0c61f8 (table test-table [id=05771e606c784e849359685e1baae0cd]) successfully deleted
I20260810 14:50:58.728174 9452 ts_tablet_manager.cc:1905] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:50:58.730499 9452 ts_tablet_manager.cc:1918] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:50:58.730662 9452 log.cc:1196] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/7eefa4001e054d719bdcf075af0c61f8
I20260810 14:50:58.730993 9452 ts_tablet_manager.cc:1939] T 7eefa4001e054d719bdcf075af0c61f8 P 901d7e85d5914e5cb49f5df755f519ae: Deleting consensus metadata
I20260810 14:50:58.731626 8521 catalog_manager.cc:4841] TS 901d7e85d5914e5cb49f5df755f519ae (127.19.29.195:39543): tablet 7eefa4001e054d719bdcf075af0c61f8 (table test-table [id=05771e606c784e849359685e1baae0cd]) successfully deleted
W20260810 14:50:58.738458 8523 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:38637 (error 108)
I20260810 14:50:58.739312 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.739159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:38637 (local address 127.0.0.1:44022)
0810 14:50:58.739215 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.739273 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:38637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 14:50:58.739449 8523 catalog_manager.cc:4584] TS 0cc39073db9045ce8cf8104604a45389 (127.19.29.193:38637): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7eefa4001e054d719bdcf075af0c61f8: Network error: Client connection negotiation failed: client connection to 127.19.29.193:38637: connect: Connection refused (error 111)
I20260810 14:50:58.740053 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 8882
I20260810 14:50:58.757519 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 9110
I20260810 14:50:58.806895 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.806719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:38637 (local address 127.0.0.1:44024)
0810 14:50:58.806799 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.806841 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:38637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260810 14:50:58.808513 9386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:50:58.808397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:38637 (local address 127.0.0.1:44036)
0810 14:50:58.808449 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 14:50:58.808480 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:38637: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260810 14:50:58.816001 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 8493
I20260810 14:50:58.833724 19575 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260810 14:50:59.177484 19575 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260810 14:50:59.177598 19575 mini_ranger.cc:66] Stopping Ranger...
I20260810 14:50:59.521401 19575 mini_ranger.cc:68] Stopped Ranger
2026-08-10 14:50:59.521 UTC [6852] LOG: received smart shutdown request
2026-08-10 14:50:59.526 UTC [6852] LOG: background worker "logical replication launcher" (PID 6870) exited with exit code 1
2026-08-10 14:50:59.526 UTC [6861] LOG: shutting down
2026-08-10 14:50:59.667 UTC [6852] LOG: database system is shut down
2026-08-10T14:50:59Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (45882 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:50:59 dist-test-slave-4tdj krb5kdc[9469](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:50:59 dist-test-slave-4tdj krb5kdc[9469](info): set up 2 sockets
Aug 10 14:50:59 dist-test-slave-4tdj krb5kdc[9469](info): commencing operation
krb5kdc: starting...
W20260810 14:51:00.913880 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:51:00 dist-test-slave-4tdj krb5kdc[9469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:51:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:51:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:51:01.037700 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:41961
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:01.118449 9492 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:01.118657 9492 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:01.118680 9492 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:01.119760 9492 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:01.119792 9492 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:01.119805 9492 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:01.119815 9492 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:01.119827 9492 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:01.121290 9492 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:41961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9492
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:01.121491 9492 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:01.121675 9492 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:01.126348 9498 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:01.126353 9509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:01.126413 9492 server_base.cc:1034] running on GCE node
W20260810 14:51:01.126353 9502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:01.126868 9492 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:01.127146 9492 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:01.128302 9492 hybrid_clock.cc:648] HybridClock initialized: now 1786373461128284 us; error 34 us; skew 500 ppm
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:01.130764 9492 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:01.131140 9492 webserver.cc:460] Webserver started at http://127.19.29.254:38619/ using document root <none> and password file <none>
I20260810 14:51:01.131332 9492 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:01.131371 9492 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:01.131457 9492 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:01.132453 9492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "303f39ec094b45018c534d464ba07976"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "c6652aa9afd41b29d5927b587200aba9"
server_key_iv: "9f80b1cc044464e208f12cc56bef935a"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.132761 9492 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "303f39ec094b45018c534d464ba07976"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "c6652aa9afd41b29d5927b587200aba9"
server_key_iv: "9f80b1cc044464e208f12cc56bef935a"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.133934 9492 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:01.134603 9519 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:01.134763 9492 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:51:01.134848 9492 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "303f39ec094b45018c534d464ba07976"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "c6652aa9afd41b29d5927b587200aba9"
server_key_iv: "9f80b1cc044464e208f12cc56bef935a"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.134902 9492 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:01.165711 9492 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:01.167925 9492 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:01.168057 9492 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:01.171947 9492 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:41961
I20260810 14:51:01.171988 9614 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:41961 every 8 connection(s)
I20260810 14:51:01.172335 9492 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:01.172849 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 9492
I20260810 14:51:01.172947 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:51:01.173158 19575 external_mini_cluster.cc:1428] Setting key ec4f008385fe3103ffb85172582a8183
I20260810 14:51:01.173400 9615 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:01.175437 9615 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.29.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.253@KRBTEST.COM" created.
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:01.189303 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.176104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:41961 (local address 127.0.0.1:40036)
0810 14:51:01.176268 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.176310 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.176768 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.177102 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.177104 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.177391 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.177554 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.177559 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.179037 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.179038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.179706 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.179708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.180371 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.180372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.180431 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.180921 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.180929 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.185872 (+ 4943us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.187706 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.187715 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.187717 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.187947 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.188218 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.188219 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.188219 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.188309 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.188738 (+ 429us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.188745 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.188810 (+ 65us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.188895 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.189031 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":76,"threads_started":1}
I20260810 14:51:01.189309 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.176295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40036 (local address 127.19.29.254:41961)
0810 14:51:01.176459 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.176463 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.176504 (+ 41us) server_negotiation.cc:407] Connection header received
0810 14:51:01.176930 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.176932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.176967 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.177099 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.177653 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.178942 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.179787 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.180293 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.180410 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.185972 (+ 5562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.185983 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.185983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.185992 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.187617 (+ 1625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.188042 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.188046 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.188047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.188153 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.188365 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.188366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.188366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.188651 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.188737 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.188959 (+ 222us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.189116 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":126,"thread_start_us":76,"threads_started":1}
I20260810 14:51:01.190102 9615 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.190480 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.190351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32770)
0810 14:51:01.190398 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.190455 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:51:01.190629 9520 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
I20260810 14:51:01.191043 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.190942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32778)
0810 14:51:01.190992 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.191022 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:51:01.191145 9615 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43199: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
I20260810 14:51:01.198683 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:43199
--webserver_interface=127.19.29.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:01.240352 9615 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } attempt: 1
I20260810 14:51:01.240899 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.240756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32782)
0810 14:51:01.240823 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.240868 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 14:51:01.241279 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.241194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32784)
0810 14:51:01.241234 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.241260 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 14:51:01.241376 9615 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43199: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
W20260810 14:51:01.280807 9623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:01.281006 9623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:01.281029 9623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:01.282094 9623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:01.282131 9623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:01.282146 9623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:01.282159 9623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:01.282172 9623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:01.283668 9623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:43199
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.29.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:01.283865 9623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:01.284041 9623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:01.288914 9633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:01.288983 9634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:01.288914 9636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:01.289021 9623 server_base.cc:1034] running on GCE node
I20260810 14:51:01.289374 9623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:01.289645 9623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:01.290783 9623 hybrid_clock.cc:648] HybridClock initialized: now 1786373461290768 us; error 29 us; skew 500 ppm
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:01.293251 9623 init.cc:377] Logged in from keytab as kudu/127.19.29.253@KRBTEST.COM (short username kudu)
I20260810 14:51:01.293680 9623 webserver.cc:460] Webserver started at http://127.19.29.253:44353/ using document root <none> and password file <none>
I20260810 14:51:01.293896 9623 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:01.293943 9623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:01.294072 9623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:01.295123 9623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data/instance:
uuid: "4ffdad7f21274fcabac21b87b1800151"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "4f11b4c73db60e79cb3d5af7bf229176"
server_key_iv: "e221830490155ed7beb0766b0f050a39"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.295461 9623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal/instance:
uuid: "4ffdad7f21274fcabac21b87b1800151"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "4f11b4c73db60e79cb3d5af7bf229176"
server_key_iv: "e221830490155ed7beb0766b0f050a39"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.296670 9623 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:51:01.297317 9648 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:01.297463 9623 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:51:01.297578 9623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "4ffdad7f21274fcabac21b87b1800151"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "4f11b4c73db60e79cb3d5af7bf229176"
server_key_iv: "e221830490155ed7beb0766b0f050a39"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.297640 9623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:01.309542 9615 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } attempt: 2
I20260810 14:51:01.309969 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.309836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32792)
0810 14:51:01.309893 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.309936 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:51:01.310262 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.310193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32800)
0810 14:51:01.310224 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.310247 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260810 14:51:01.310348 9615 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43199: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43199: connect: Connection refused (error 111)
I20260810 14:51:01.311967 9623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:01.313705 9623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:01.313841 9623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:01.317906 9623 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.253:43199
I20260810 14:51:01.317939 9733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.253:43199 every 8 connection(s)
I20260810 14:51:01.318277 9623 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
I20260810 14:51:01.319164 9736 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:01.320698 9736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.323371 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 9623
I20260810 14:51:01.323477 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-1/wal/instance
I20260810 14:51:01.323668 19575 external_mini_cluster.cc:1428] Setting key 653b9eed179c2453e11770dd9508bb5c
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:01.330193 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.321377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40038 (local address 127.19.29.254:41961)
0810 14:51:01.321438 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.321440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.321592 (+ 152us) server_negotiation.cc:407] Connection header received
0810 14:51:01.322053 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.322053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.322065 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.322122 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.322764 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.323304 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.324636 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.324835 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.324893 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.327078 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.327080 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.327080 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.327088 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.328897 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.329293 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.329294 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.329295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.329360 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.329586 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.329587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.329587 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.329724 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.329797 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.330013 (+ 216us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.330101 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:51:01.330253 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.321325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:41961 (local address 127.0.0.1:40038)
0810 14:51:01.321480 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.321521 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.321975 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.322187 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.322190 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.322470 (+ 280us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.322686 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.322691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.323389 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.323390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.324535 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.324538 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.324915 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.324916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.325057 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.325628 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.325637 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.326986 (+ 1349us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.328987 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.328995 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.328997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.329215 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.329424 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.329425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.329425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.329521 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.329785 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.329789 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.329897 (+ 108us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.329973 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.330093 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260810 14:51:01.331055 9736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.19.29.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.252@KRBTEST.COM" created.
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:51:01.338088 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.331286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32802)
0810 14:51:01.331326 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.331336 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.331373 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.331635 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.331636 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.331759 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.331802 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.331803 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.332654 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.332655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.333242 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.333244 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.333674 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.333675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.333736 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.334116 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.334121 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.335433 (+ 1312us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.337040 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.337041 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.337042 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.337242 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.337429 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.337429 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.337430 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.337493 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.337765 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.337766 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.337812 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.337886 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.337984 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260810 14:51:01.338182 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.331352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.19.29.253:43199)
0810 14:51:01.331492 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.331497 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.331515 (+ 18us) server_negotiation.cc:407] Connection header received
0810 14:51:01.331530 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.331532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.331542 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.331623 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.331864 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.332569 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.333317 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.333613 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.333668 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.335514 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.335523 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.335524 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.335531 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.336939 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.337320 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.337322 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.337323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.337372 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.337549 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.337550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.337550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.337701 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.337762 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.337909 (+ 147us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.338032 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":60,"server-negotiator.queue_time_us":114,"thread_start_us":91,"threads_started":1}
I20260810 14:51:01.338742 9736 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.339089 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.338957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37946)
0810 14:51:01.339006 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.339064 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 14:51:01.339231 9653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
I20260810 14:51:01.339659 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.339555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37954)
0810 14:51:01.339605 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.339637 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 14:51:01.339763 9736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:36381: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
I20260810 14:51:01.348642 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:36381
--webserver_interface=127.19.29.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:01.389008 9736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } attempt: 1
I20260810 14:51:01.389613 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.389407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37958)
0810 14:51:01.389476 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.389525 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 14:51:01.390050 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.389930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37966)
0810 14:51:01.389990 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.390023 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260810 14:51:01.390164 9736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:36381: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
I20260810 14:51:01.401470 9615 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } attempt: 3
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:51:01.408128 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.401797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32818 (local address 127.19.29.253:43199)
0810 14:51:01.401851 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.401853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.401864 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:51:01.401932 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.401932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.401945 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.401989 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.402327 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.402848 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.403525 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.403737 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.403792 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.405789 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.405791 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.405791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.405799 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.407153 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.407456 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.407458 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.407458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.407508 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.407670 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.407671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.407671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.407773 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.407829 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.407964 (+ 135us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.408037 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:51:01.408146 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.401758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32818)
0810 14:51:01.401807 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.401819 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.401872 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.402008 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.402009 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.402166 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.402232 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.402234 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.402927 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.402928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.403446 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.403447 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.403797 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.403798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.403869 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.404312 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.404316 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.405704 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.407229 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.407230 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.407230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.407395 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.407562 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.407563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.407563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.407620 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.407828 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.407829 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.407877 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.407937 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.408037 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:51:01.408500 9615 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.408839 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.408750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37978)
0810 14:51:01.408793 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.408820 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:51:01.409134 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.409044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:37994)
0810 14:51:01.409090 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.409114 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 14:51:01.409260 9615 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:36381: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
W20260810 14:51:01.429780 9745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:01.429953 9745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:01.429973 9745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:01.431075 9745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:01.431113 9745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:01.431124 9745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:01.431135 9745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:01.431145 9745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:01.432578 9745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:41961,127.19.29.253:43199,127.19.29.252:36381
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:36381
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.29.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:01.432789 9745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:01.432958 9745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:01.437451 9753 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:01.437458 9757 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:01.437469 9751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:01.437619 9745 server_base.cc:1034] running on GCE node
I20260810 14:51:01.437963 9745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:01.438226 9745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:01.439373 9745 hybrid_clock.cc:648] HybridClock initialized: now 1786373461439368 us; error 39 us; skew 500 ppm
I20260810 14:51:01.440414 9615 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } attempt: 1
I20260810 14:51:01.440789 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.440684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38006)
0810 14:51:01.440733 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.440761 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260810 14:51:01.441130 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.441039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38010)
0810 14:51:01.441088 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.441112 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260810 14:51:01.441603 9615 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:36381: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
I20260810 14:51:01.441848 9745 init.cc:377] Logged in from keytab as kudu/127.19.29.252@KRBTEST.COM (short username kudu)
I20260810 14:51:01.442237 9745 webserver.cc:460] Webserver started at http://127.19.29.252:41557/ using document root <none> and password file <none>
I20260810 14:51:01.442458 9745 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:01.442507 9745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:01.442634 9745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:01.443595 9745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data/instance:
uuid: "df5ff8d37aed4cb4a65ef56998011a97"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "118c5f05f3c8017fd105a6cead40fd55"
server_key_iv: "c0d50329c1daac11206116cfbeb7b007"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.443902 9745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal/instance:
uuid: "df5ff8d37aed4cb4a65ef56998011a97"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "118c5f05f3c8017fd105a6cead40fd55"
server_key_iv: "c0d50329c1daac11206116cfbeb7b007"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.445093 9745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:51:01.445744 9772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:01.445894 9745 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:01.445977 9745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "df5ff8d37aed4cb4a65ef56998011a97"
format_stamp: "Formatted at 2026-08-10 14:51:01 on dist-test-slave-4tdj"
server_key: "118c5f05f3c8017fd105a6cead40fd55"
server_key_iv: "c0d50329c1daac11206116cfbeb7b007"
server_key_version: "encryptionkey@0"
I20260810 14:51:01.446036 9745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:01.453845 9745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:01.455402 9745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:01.455523 9745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:01.458331 9736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } attempt: 2
I20260810 14:51:01.458683 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.458582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38012)
0810 14:51:01.458621 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.458650 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260810 14:51:01.459025 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.458900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38020)
0810 14:51:01.458958 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.458995 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 14:51:01.459170 9736 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:36381: Network error: Client connection negotiation failed: client connection to 127.19.29.252:36381: connect: Connection refused (error 111)
I20260810 14:51:01.459384 9745 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.252:36381
I20260810 14:51:01.459427 9848 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.252:36381 every 8 connection(s)
I20260810 14:51:01.459723 9745 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
I20260810 14:51:01.460510 9849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:01.461891 9849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.463167 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 9745
I20260810 14:51:01.463250 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786373310130398-19575-0/minicluster-data/master-2/wal/instance
I20260810 14:51:01.463405 19575 external_mini_cluster.cc:1428] Setting key 3ba6752fd9e22b55fb2f8ce4876ad77f
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:51:01.470587 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.462508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40040 (local address 127.19.29.254:41961)
0810 14:51:01.462561 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.462563 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.462759 (+ 196us) server_negotiation.cc:407] Connection header received
0810 14:51:01.463205 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.463207 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.463219 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.463270 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.463970 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.464444 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.465371 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.465580 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.465635 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.467881 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.467883 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.467883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.467892 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.469175 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.469638 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.469640 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.469640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.469707 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.469955 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.469957 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.469957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.470083 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.470141 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.470451 (+ 310us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.470517 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:51:01.470847 9854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.462481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:41961 (local address 127.0.0.1:40040)
0810 14:51:01.462649 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.462683 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.463108 (+ 425us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.463369 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.463372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.463644 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.463890 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.463896 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.464528 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.464529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.465291 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.465293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.465649 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.465650 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.465785 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.466216 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.466224 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.467796 (+ 1572us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.469232 (+ 1436us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.469239 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.469242 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.469556 (+ 314us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.469773 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.469773 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.469774 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.469875 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.470150 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.470154 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.470321 (+ 167us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.470437 (+ 116us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.470642 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260810 14:51:01.471359 9849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.471843 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.463756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38028 (local address 127.19.29.252:36381)
0810 14:51:01.463926 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.463930 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.463952 (+ 22us) server_negotiation.cc:407] Connection header received
0810 14:51:01.463974 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.463976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.463994 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.464063 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.464599 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.465331 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.466002 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.466330 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.466388 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.468849 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.468857 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.468857 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.468863 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.470670 (+ 1807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.471005 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.471008 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.471008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.471065 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.471236 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.471237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.471238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.471399 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.471539 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.471669 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.471747 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":114,"threads_started":1}
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:01.477675 9854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.471598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43199 (local address 127.0.0.1:32822)
0810 14:51:01.471704 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.471713 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.471777 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.471894 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.471895 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.472019 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.472076 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.472077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.472862 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.472863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.473309 (+ 446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.473310 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.473637 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.473638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.473702 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.474031 (+ 329us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.474034 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.475073 (+ 1039us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.476740 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.476741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.476741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.476888 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.477070 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.477071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.477071 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.477128 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.477391 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.477392 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.477436 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.477505 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.477612 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92}
I20260810 14:51:01.477691 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.471659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32822 (local address 127.19.29.253:43199)
0810 14:51:01.471712 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.471713 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.471755 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:51:01.471832 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.471833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.471843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.471890 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.472138 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.472793 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.473381 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.473582 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.473635 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.475144 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.475146 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.475146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.475153 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.476666 (+ 1513us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.476962 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.476963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.476963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.477015 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.477195 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.477196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.477197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.477332 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.477393 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.477532 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.477611 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:51:01.478214 9849 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:51:01.479589 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.472553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40042 (local address 127.19.29.254:41961)
0810 14:51:01.472600 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.472601 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.472609 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:01.472632 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.472633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.472641 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.472682 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.473132 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.473554 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.474271 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.474494 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.474546 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.476920 (+ 2374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.476922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.476922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.476928 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.478488 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.478847 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.478848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.478848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.478921 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.479092 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.479093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.479093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.479212 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.479389 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.479423 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.479491 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373460, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:51:01.484476 9854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.478450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38040)
0810 14:51:01.478491 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.478500 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.478532 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.478633 (+ 101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.478634 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.478758 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.478788 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.478789 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.479565 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.479566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.480312 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.480314 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.480753 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.480754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.480802 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.481096 (+ 294us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.481101 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.482431 (+ 1330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.483663 (+ 1232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.483664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.483664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.483805 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.483951 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.483952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.483952 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.484011 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.484201 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.484202 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.484238 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.484296 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.484386 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:51:01.484539 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.478494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38040 (local address 127.19.29.252:36381)
0810 14:51:01.478523 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.478525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.478533 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:01.478584 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.478585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.478592 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.478629 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.478846 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.479481 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.480385 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.480695 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.480754 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.482505 (+ 1751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.482506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.482506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.482512 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.483594 (+ 1082us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.483859 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.483860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.483861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.483905 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.484057 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.484058 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.484058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.484152 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.484203 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.484323 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.484435 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":14}
I20260810 14:51:01.486111 9849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: Bootstrap starting.
I20260810 14:51:01.487141 9849 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:01.487164 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.480121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32836 (local address 127.19.29.253:43199)
0810 14:51:01.480156 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.480157 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.480165 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:01.480183 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.480184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.480191 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.480254 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.480723 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.481349 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.482209 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.482476 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.482534 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.484522 (+ 1988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.484524 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.484524 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.484531 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.486066 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.486431 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.486432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.486432 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.486499 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.486669 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.486670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.486670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.486794 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.486964 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.487013 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.487086 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:51:01.487414 9849 log.cc:824] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:01.488121 9849 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: No bootstrap required, opened a new log
I20260810 14:51:01.488685 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:51:01.489487 9849 raft_consensus.cc:348] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.489634 9849 raft_consensus.cc:374] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:01.489676 9849 raft_consensus.cc:729] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5ff8d37aed4cb4a65ef56998011a97, State: Initialized, Role: FOLLOWER
I20260810 14:51:01.489790 9849 consensus_queue.cc:260] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.490082 9849 sys_catalog.cc:564] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:01.490423 9868 sys_catalog.cc:455] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.490509 9868 sys_catalog.cc:458] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:51:01.491998 9890 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:51:01.493275 9890 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:51:01.494690 9745 master_runner.cc:186] Error getting master registration for 127.19.29.254:41961: OK, instance_id { permanent_uuid: "303f39ec094b45018c534d464ba07976" instance_seqno: 1786373461170877 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:51:01.496904 9745 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:51:01.497210 9741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.489934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32844 (local address 127.19.29.253:43199)
0810 14:51:01.489966 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.489968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.490105 (+ 137us) server_negotiation.cc:407] Connection header received
0810 14:51:01.490157 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.490158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.490167 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.490208 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.490935 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.491599 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.492529 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.492800 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.492852 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.494458 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.494459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.494459 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.494466 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.495891 (+ 1425us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.496258 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.496259 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.496259 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.496313 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.496497 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.496498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.496498 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.496612 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.496706 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.497060 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.497133 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:51:01.497702 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.490897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38056 (local address 127.19.29.252:36381)
0810 14:51:01.491571 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.491573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.491678 (+ 105us) server_negotiation.cc:407] Connection header received
0810 14:51:01.491764 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.491765 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.491773 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.491800 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.492381 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.492795 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.493589 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.493805 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.493835 (+ 30us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.495017 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.495018 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.495019 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.495025 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.496490 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.496811 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.496812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.496813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.496864 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.497058 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.497059 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.497059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.497291 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.497362 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.497547 (+ 185us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.497611 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":658}
I20260810 14:51:01.502826 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.490744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40054 (local address 127.19.29.254:41961)
0810 14:51:01.490779 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.490781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.491116 (+ 335us) server_negotiation.cc:407] Connection header received
0810 14:51:01.491147 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.491148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.491158 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.491219 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.497182 (+ 5963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.497851 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.499067 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.499254 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.499305 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.500552 (+ 1247us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.500554 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.500554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.500560 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.501831 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.502178 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.502179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.502179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.502221 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.502411 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.502411 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.502412 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.502514 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.502578 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.502715 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.502769 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:51:01.516743 9615 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } attempt: 2
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:51:01.523608 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.517001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38062)
0810 14:51:01.517076 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.517088 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.517141 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.517279 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.517279 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.517396 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.517430 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.517431 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.518325 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.518326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.518822 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.518824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.519260 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.519261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.519303 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.519676 (+ 373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.519680 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.521061 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.522706 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.522706 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.522707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.522856 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.523046 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.523047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.523048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.523115 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.523364 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.523365 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.523401 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.523446 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.523546 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260810 14:51:01.523646 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.517095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38062 (local address 127.19.29.252:36381)
0810 14:51:01.517151 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.517153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.517163 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:51:01.517185 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.517186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.517195 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.517251 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.517491 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.518230 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.518890 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.519187 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.519246 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.521141 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.521143 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.521143 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.521150 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.522630 (+ 1480us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.522915 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.522916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.522916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.522970 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.523180 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.523181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.523181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.523302 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.523360 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.523480 (+ 120us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.523561 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:51:01.525043 9615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: Bootstrap starting.
I20260810 14:51:01.525664 9615 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:01.525934 9615 log.cc:824] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:01.526644 9615 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: No bootstrap required, opened a new log
I20260810 14:51:01.527971 9615 raft_consensus.cc:348] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.528083 9615 raft_consensus.cc:374] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:01.528115 9615 raft_consensus.cc:729] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 303f39ec094b45018c534d464ba07976, State: Initialized, Role: FOLLOWER
I20260810 14:51:01.528236 9615 consensus_queue.cc:260] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.528529 9615 sys_catalog.cc:564] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:01.528482 9897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.528587 9897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:51:01.530563 9913 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:51:01.530616 9913 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:51:01.530913 9492 master_runner.cc:186] Error getting master registration for 127.19.29.253:43199: OK, instance_id { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" instance_seqno: 1786373461316761 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:51:01.533010 9492 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:51:01.550320 9736 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } attempt: 3
Aug 10 14:51:01 dist-test-slave-4tdj krb5kdc[9469](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373461, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:51:01.558559 9857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.550650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.19.29.252:36381)
0810 14:51:01.550770 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:01.550772 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:01.550779 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:51:01.550798 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:01.550799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:01.550808 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:01.550856 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:01.551219 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.551912 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.552881 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.553148 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.553225 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.555427 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:01.555429 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:01.555429 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:01.555437 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:01.557066 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.557721 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.557723 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.557723 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.557786 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:01.557981 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:01.557982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:01.557983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:01.558133 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:01.558201 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:01.558390 (+ 189us) server_negotiation.cc:299] Negotiation successful
0810 14:51:01.558467 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260810 14:51:01.558573 9739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:01.550600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:36381 (local address 127.0.0.1:38078)
0810 14:51:01.550652 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:01.550663 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:01.550700 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:01.550884 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:01.550885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:01.551081 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:01.551133 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.551135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.552001 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.552002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.552788 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:01.552790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:01.553226 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:01.553227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:01.553284 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:01.553770 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:01.553776 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:01.555341 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:01.557153 (+ 1812us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.557154 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.557154 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.557399 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.557853 (+ 454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:01.557854 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:01.557855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:01.557913 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:01.558201 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:01.558202 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:01.558250 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 14:51:01.558361 (+ 111us) client_negotiation.cc:240] Negotiation successful
0810 14:51:01.558462 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 14:51:01.560431 9736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: Bootstrap starting.
I20260810 14:51:01.561156 9736 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:01.561448 9736 log.cc:824] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:01.562358 9736 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: No bootstrap required, opened a new log
I20260810 14:51:01.564278 9736 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.564399 9736 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:01.564429 9736 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffdad7f21274fcabac21b87b1800151, State: Initialized, Role: FOLLOWER
I20260810 14:51:01.564560 9736 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.564865 9736 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:01.564842 9916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.565050 9916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:51:01.566785 9936 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:51:01.566898 9936 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:51:01.568922 9623 master_runner.cc:263] No leader master found from master 4ffdad7f21274fcabac21b87b1800151
I20260810 14:51:01.568967 9623 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:51:01.639411 9916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:01.639551 9916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.639786 9916 leader_election.cc:288] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 303f39ec094b45018c534d464ba07976 (127.19.29.254:41961), df5ff8d37aed4cb4a65ef56998011a97 (127.19.29.252:36381)
I20260810 14:51:01.640223 9562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ffdad7f21274fcabac21b87b1800151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303f39ec094b45018c534d464ba07976" is_pre_election: true
I20260810 14:51:01.640369 9562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ffdad7f21274fcabac21b87b1800151 in term 0.
I20260810 14:51:01.640765 9812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ffdad7f21274fcabac21b87b1800151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5ff8d37aed4cb4a65ef56998011a97" is_pre_election: true
I20260810 14:51:01.640908 9812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ffdad7f21274fcabac21b87b1800151 in term 0.
I20260810 14:51:01.641183 9653 leader_election.cc:302] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffdad7f21274fcabac21b87b1800151, df5ff8d37aed4cb4a65ef56998011a97; no voters:
I20260810 14:51:01.641391 9916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:51:01.641450 9916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:51:01.641472 9916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:01.642563 9916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.642678 9916 leader_election.cc:288] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [CANDIDATE]: Term 1 election: Requested vote from peers 303f39ec094b45018c534d464ba07976 (127.19.29.254:41961), df5ff8d37aed4cb4a65ef56998011a97 (127.19.29.252:36381)
I20260810 14:51:01.642910 9562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ffdad7f21274fcabac21b87b1800151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "303f39ec094b45018c534d464ba07976"
I20260810 14:51:01.642978 9562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:01.643775 9562 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ffdad7f21274fcabac21b87b1800151 in term 1.
I20260810 14:51:01.644028 9812 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ffdad7f21274fcabac21b87b1800151" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5ff8d37aed4cb4a65ef56998011a97"
I20260810 14:51:01.644098 9812 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:01.644783 9812 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ffdad7f21274fcabac21b87b1800151 in term 1.
I20260810 14:51:01.644982 9653 leader_election.cc:302] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffdad7f21274fcabac21b87b1800151, df5ff8d37aed4cb4a65ef56998011a97; no voters:
I20260810 14:51:01.645123 9916 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:01.645265 9916 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [term 1 LEADER]: Becoming Leader. State: Replica: 4ffdad7f21274fcabac21b87b1800151, State: Running, Role: LEADER
I20260810 14:51:01.645344 9916 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } }
I20260810 14:51:01.645673 9916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ffdad7f21274fcabac21b87b1800151. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.645730 9916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:01.646018 9950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:01.646231 9950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:01.649037 9812 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [term 1 FOLLOWER]: Refusing update from remote peer 4ffdad7f21274fcabac21b87b1800151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:01.649626 9562 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [term 1 FOLLOWER]: Refusing update from remote peer 4ffdad7f21274fcabac21b87b1800151: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:01.649407 9941 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:01.649936 9916 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [LEADER]: Connected to new peer: Peer: permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:01.651247 9897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ffdad7f21274fcabac21b87b1800151. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.651350 9897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:51:01.651422 9868 sys_catalog.cc:455] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ffdad7f21274fcabac21b87b1800151. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.651496 9868 sys_catalog.cc:458] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:51:01.652365 9916 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.652446 9916 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:01.652467 9897 sys_catalog.cc:455] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.652544 9897 sys_catalog.cc:458] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:51:01.652760 9951 mvcc.cc:205] Tried to move back new op lower bound from 7316985698912546816 to 7316985698899771392. Current Snapshot: MvccSnapshot[applied={T|T < 7316985698912546816}]
I20260810 14:51:01.653203 9953 mvcc.cc:205] Tried to move back new op lower bound from 7316985698912546816 to 7316985698899771392. Current Snapshot: MvccSnapshot[applied={T|T < 7316985698912546816}]
I20260810 14:51:01.654124 9941 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.654206 9941 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:01.654517 9868 sys_catalog.cc:455] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ffdad7f21274fcabac21b87b1800151" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "303f39ec094b45018c534d464ba07976" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 41961 } } peers { permanent_uuid: "4ffdad7f21274fcabac21b87b1800151" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43199 } } peers { permanent_uuid: "df5ff8d37aed4cb4a65ef56998011a97" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 36381 } } }
I20260810 14:51:01.654595 9868 sys_catalog.cc:458] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:51:01.654888 9950 catalog_manager.cc:1347] Generated new cluster ID: 3741f2aede434a9b99a8d0f2204d2b96
I20260810 14:51:01.654947 9950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:51:01.658707 9954 mvcc.cc:205] Tried to move back new op lower bound from 7316985698912546816 to 7316985698899771392. Current Snapshot: MvccSnapshot[applied={T|T < 7316985698912546816}]
I20260810 14:51:01.678892 9950 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:51:01.679534 9950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:51:01.681762 9950 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ffdad7f21274fcabac21b87b1800151: Generated new TSK 0
I20260810 14:51:01.681967 9950 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:51:02.493795 9890 catalog_manager.cc:1259] Loaded cluster ID: 3741f2aede434a9b99a8d0f2204d2b96
I20260810 14:51:02.493870 9890 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: loading cluster ID for follower catalog manager: success
I20260810 14:51:02.494724 9890 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: acquiring CA information for follower catalog manager: success
I20260810 14:51:02.495028 9890 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df5ff8d37aed4cb4a65ef56998011a97: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:51:02.531077 9913 catalog_manager.cc:1259] Loaded cluster ID: 3741f2aede434a9b99a8d0f2204d2b96
I20260810 14:51:02.531154 9913 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: loading cluster ID for follower catalog manager: success
I20260810 14:51:02.531996 9913 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: acquiring CA information for follower catalog manager: success
I20260810 14:51:02.532290 9913 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 303f39ec094b45018c534d464ba07976: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:51:02.731222 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 9492
I20260810 14:51:02.743090 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 9623
I20260810 14:51:02.755440 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 9745
2026-08-10T14:51:02Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3008 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:51:02 dist-test-slave-4tdj krb5kdc[9974](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:51:02 dist-test-slave-4tdj krb5kdc[9974](info): set up 2 sockets
Aug 10 14:51:02 dist-test-slave-4tdj krb5kdc[9974](info): commencing operation
krb5kdc: starting...
W20260810 14:51:03.929313 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:51:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:51:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:51:04.049278 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:35257
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45993
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:35257
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:04.128911 9998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:04.129097 9998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:04.129117 9998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:04.130189 9998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:04.130223 9998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:04.130234 9998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:04.130245 9998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:04.130255 9998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:04.131773 9998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45993
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:35257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:35257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:04.131963 9998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:04.132131 9998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:04.136705 10005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:04.136710 10007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:04.136715 10004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:04.136919 9998 server_base.cc:1034] running on GCE node
I20260810 14:51:04.137162 9998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:04.137423 9998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:04.138559 9998 hybrid_clock.cc:648] HybridClock initialized: now 1786373464138544 us; error 30 us; skew 500 ppm
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[9974](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373464, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:04.140902 9998 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:04.141312 9998 webserver.cc:460] Webserver started at http://127.19.29.254:36953/ using document root <none> and password file <none>
I20260810 14:51:04.141530 9998 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:04.141572 9998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:04.141683 9998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:04.142688 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0"
format_stamp: "Formatted at 2026-08-10 14:51:04 on dist-test-slave-4tdj"
server_key: "fb9be04cf9041f197c7aee048b8bbc6e"
server_key_iv: "03835fab803956292d7c2a66f15ea6e9"
server_key_version: "encryptionkey@0"
I20260810 14:51:04.143005 9998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0"
format_stamp: "Formatted at 2026-08-10 14:51:04 on dist-test-slave-4tdj"
server_key: "fb9be04cf9041f197c7aee048b8bbc6e"
server_key_iv: "03835fab803956292d7c2a66f15ea6e9"
server_key_version: "encryptionkey@0"
I20260810 14:51:04.144254 9998 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:04.144881 10021 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:04.145033 9998 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:04.145123 9998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0"
format_stamp: "Formatted at 2026-08-10 14:51:04 on dist-test-slave-4tdj"
server_key: "fb9be04cf9041f197c7aee048b8bbc6e"
server_key_iv: "03835fab803956292d7c2a66f15ea6e9"
server_key_version: "encryptionkey@0"
I20260810 14:51:04.145188 9998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:04.168011 9998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:04.169811 9998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:04.169948 9998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:04.174011 9998 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:35257
I20260810 14:51:04.174048 10112 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:35257 every 8 connection(s)
I20260810 14:51:04.174443 9998 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:04.175331 10114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:04.177585 10114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0: Bootstrap starting.
I20260810 14:51:04.178146 10114 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:04.178401 10114 log.cc:824] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:04.179051 10114 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0: No bootstrap required, opened a new log
I20260810 14:51:04.180624 10114 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } }
I20260810 14:51:04.180760 10114 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:04.180781 10114 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1f45bab0aaa4b3cb11bd2bc66eb3cb0, State: Initialized, Role: FOLLOWER
I20260810 14:51:04.180894 10114 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } }
I20260810 14:51:04.180969 10114 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:04.181001 10114 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:04.181034 10114 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:04.181516 10114 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } }
I20260810 14:51:04.181608 10114 leader_election.cc:302] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1f45bab0aaa4b3cb11bd2bc66eb3cb0; no voters:
I20260810 14:51:04.181735 10114 leader_election.cc:288] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:51:04.181808 10118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:04.181965 10114 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:04.181978 10118 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [term 1 LEADER]: Becoming Leader. State: Replica: f1f45bab0aaa4b3cb11bd2bc66eb3cb0, State: Running, Role: LEADER
I20260810 14:51:04.182101 10118 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } }
I20260810 14:51:04.182495 10121 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1f45bab0aaa4b3cb11bd2bc66eb3cb0. Latest consensus state: current_term: 1 leader_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } } }
I20260810 14:51:04.182632 10120 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1f45bab0aaa4b3cb11bd2bc66eb3cb0" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 35257 } } }
I20260810 14:51:04.182637 10121 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:04.182735 10120 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:04.182963 10132 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:04.183627 10132 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:04.183899 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 9998
I20260810 14:51:04.183998 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:51:04.184201 19575 external_mini_cluster.cc:1428] Setting key d1b1ca66d32e35335650c42ea1a19644
I20260810 14:51:04.185072 10132 catalog_manager.cc:1347] Generated new cluster ID: 97f5bdc032dd4391ae8e974b70efcbc0
I20260810 14:51:04.185127 10132 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[9974](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373464, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:04.194737 10146 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:04.184787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.19.29.254:35257)
0810 14:51:04.186422 (+ 1635us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:04.186430 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:04.186460 (+ 30us) server_negotiation.cc:407] Connection header received
0810 14:51:04.186676 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:04.186682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:04.186728 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:04.186842 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:04.187443 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:04.188378 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:04.189105 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:04.189531 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:04.189628 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:04.191793 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:04.191797 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:04.191797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:04.191808 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:04.193340 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:04.193658 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:04.193661 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:04.193661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:04.193755 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:04.193929 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:04.193930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:04.193930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:04.194164 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:04.194349 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:04.194431 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:51:04.194565 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1587,"thread_start_us":71,"threads_started":1}
I20260810 14:51:04.195580 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:51:04.196725 10132 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:51:04.197371 10132 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:51:04.209894 10132 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1f45bab0aaa4b3cb11bd2bc66eb3cb0: Generated new TSK 0
I20260810 14:51:04.210053 10132 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:51:04.249325 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 9998
2026-08-10T14:51:04Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1489 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[10154](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[10154](info): set up 2 sockets
Aug 10 14:51:04 dist-test-slave-4tdj krb5kdc[10154](info): commencing operation
krb5kdc: starting...
W20260810 14:51:05.434443 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.156s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:51:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:51:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:51:05.544600 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:44915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:05.624600 10173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:05.624792 10173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:05.624815 10173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:05.625995 10173 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:05.626055 10173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:05.626071 10173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:05.626084 10173 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:05.626097 10173 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:05.627575 10173 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:44915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:05.627801 10173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:05.628018 10173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:05.632654 10181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:05.632661 10184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:05.632718 10182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:05.632689 10173 server_base.cc:1034] running on GCE node
I20260810 14:51:05.633054 10173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:05.633306 10173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:05.634433 10173 hybrid_clock.cc:648] HybridClock initialized: now 1786373465634423 us; error 30 us; skew 500 ppm
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:05.636651 10173 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:05.637068 10173 webserver.cc:460] Webserver started at http://127.19.29.254:41247/ using document root <none> and password file <none>
I20260810 14:51:05.637249 10173 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:05.637293 10173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:05.637413 10173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:05.638432 10173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "eb8db1e1ff8b41f1be5c15ba36849110"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "d58bd0ad5708337a626265466486aad8"
server_key_iv: "2906bef583738bec6323feeffe3a7078"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.638751 10173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "eb8db1e1ff8b41f1be5c15ba36849110"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "d58bd0ad5708337a626265466486aad8"
server_key_iv: "2906bef583738bec6323feeffe3a7078"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.639943 10173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:05.640622 10193 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:05.640779 10173 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:05.640861 10173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "eb8db1e1ff8b41f1be5c15ba36849110"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "d58bd0ad5708337a626265466486aad8"
server_key_iv: "2906bef583738bec6323feeffe3a7078"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.640916 10173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:05.663079 10173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:05.664741 10173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:05.664872 10173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:05.668867 10173 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:44915
I20260810 14:51:05.668908 10297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:44915 every 8 connection(s)
I20260810 14:51:05.669238 10173 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:05.670225 10298 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:05.672499 10298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap starting.
I20260810 14:51:05.673067 10298 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:05.673329 10298 log.cc:824] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:05.674012 10298 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: No bootstrap required, opened a new log
I20260810 14:51:05.675616 10298 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:05.675755 10298 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:05.675776 10298 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Initialized, Role: FOLLOWER
I20260810 14:51:05.675900 10298 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:05.675967 10298 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:05.675990 10298 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:05.676036 10298 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:05.676803 10298 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:05.676895 10298 leader_election.cc:302] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb8db1e1ff8b41f1be5c15ba36849110; no voters:
I20260810 14:51:05.677054 10298 leader_election.cc:288] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:51:05.677099 10309 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:05.677254 10309 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 LEADER]: Becoming Leader. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Running, Role: LEADER
I20260810 14:51:05.677299 10298 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:05.677348 10309 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:05.677736 10313 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb8db1e1ff8b41f1be5c15ba36849110. Latest consensus state: current_term: 1 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:05.677821 10313 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:05.677721 10311 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:05.678061 10311 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:05.678402 10324 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:05.678704 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 10173
I20260810 14:51:05.678809 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:51:05.678917 10324 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:05.679008 19575 external_mini_cluster.cc:1428] Setting key ffa1fa877d22195048484f6c4eac80f2
I20260810 14:51:05.680560 10324 catalog_manager.cc:1347] Generated new cluster ID: e9f45839b9cf42aab82e387fe092236d
I20260810 14:51:05.680603 10324 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:51:05.690995 10324 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:51:05.691542 10324 catalog_manager.cc:1504] Loading token signing keys...
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:05.696705 10324 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Generated new TSK 0
I20260810 14:51:05.696851 10324 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:51:05.700147 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:05.679454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34960 (local address 127.19.29.254:44915)
0810 14:51:05.690382 (+ 10928us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:05.690390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:05.690421 (+ 31us) server_negotiation.cc:407] Connection header received
0810 14:51:05.690521 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:05.690526 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:05.690568 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:05.690697 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:05.691445 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.692764 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.693815 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.694413 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.694509 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:05.697214 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:05.697218 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:05.697218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:05.697228 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:05.698762 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:05.699125 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:05.699128 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:05.699128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:05.699203 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:05.699398 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:05.699399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:05.699399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:05.699606 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:05.699693 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:05.699827 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 14:51:05.699930 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10875,"thread_start_us":93,"threads_started":1}
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:51:05.724452 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:05.804178 10344 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:05.804371 10344 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:05.804401 10344 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:05.805529 10344 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:05.805572 10344 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:05.805606 10344 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:51:05.807049 10344 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10344
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:05.807267 10344 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:05.807482 10344 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:05.812225 10357 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:05.812223 10354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:05.812240 10344 server_base.cc:1034] running on GCE node
W20260810 14:51:05.812242 10353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:05.812590 10344 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:05.812834 10344 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:05.813973 10344 hybrid_clock.cc:648] HybridClock initialized: now 1786373465813958 us; error 28 us; skew 500 ppm
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:05.816421 10344 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:51:05.816817 10344 webserver.cc:460] Webserver started at http://127.19.29.193:42887/ using document root <none> and password file <none>
I20260810 14:51:05.817018 10344 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:05.817065 10344 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:05.817198 10344 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:05.818172 10344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "b2925629855d5d695b68ca97e59360ca"
server_key_iv: "a04e99533c5d5c224c62117d25d397cd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.818538 10344 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "b2925629855d5d695b68ca97e59360ca"
server_key_iv: "a04e99533c5d5c224c62117d25d397cd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.819864 10344 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:05.820590 10369 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:05.820741 10344 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:05.820827 10344 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "b2925629855d5d695b68ca97e59360ca"
server_key_iv: "a04e99533c5d5c224c62117d25d397cd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.820884 10344 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:05.852164 10344 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:05.853911 10344 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:05.854019 10344 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:05.854202 10344 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:05.854499 10344 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:05.854530 10344 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:05.854563 10344 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:05.854597 10344 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:05.860009 10344 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41137
I20260810 14:51:05.860078 10561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41137 every 8 connection(s)
I20260810 14:51:05.860360 10344 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:05.868580 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:05.861029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56139 (local address 127.19.29.254:44915)
0810 14:51:05.861073 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:05.861075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:05.861274 (+ 199us) server_negotiation.cc:407] Connection header received
0810 14:51:05.861754 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:05.861755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:05.861764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:05.861820 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:05.862776 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.863280 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.864185 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.864393 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.864447 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:05.866412 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:05.866414 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:05.866414 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:05.866420 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:05.867478 (+ 1058us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:05.867815 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:05.867816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:05.867816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:05.867862 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:05.868028 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:05.868029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:05.868029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:05.868121 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:05.868165 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:05.868412 (+ 247us) server_negotiation.cc:299] Negotiation successful
0810 14:51:05.868512 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:51:05.868639 10566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:05.860994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:56139)
0810 14:51:05.861156 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:05.861198 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:05.861678 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:05.861874 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:05.861877 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:05.862502 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:05.862691 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:05.862696 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.863340 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.863340 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:05.864108 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:05.864109 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:05.864452 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:05.864453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:05.864543 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:05.864985 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:05.864993 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:05.866320 (+ 1327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:05.867542 (+ 1222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:05.867549 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:05.867551 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:05.867760 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:05.867905 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:05.867906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:05.867906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:05.867989 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:05.868162 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:05.868165 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:05.868267 (+ 102us) client_negotiation.cc:769] Sending connection context
0810 14:51:05.868343 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:51:05.868461 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":69,"threads_started":1}
I20260810 14:51:05.869130 10562 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:05.869215 10562 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:05.869378 10562 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:05.869659 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 10344
I20260810 14:51:05.869764 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:51:05.869946 19575 external_mini_cluster.cc:1428] Setting key 98b87c03af7777437142e0bdcfb94ae0
I20260810 14:51:05.869993 10226 ts_manager.cc:194] Registered new tserver with Master: 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193:41137)
I20260810 14:51:05.870805 10226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:56139
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:51:05.893946 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:05.974231 10573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:05.974470 10573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:05.974493 10573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:05.975601 10573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:05.975634 10573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:05.975659 10573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:51:05.977120 10573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10573
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:05.977334 10573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:05.977546 10573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:05.982579 10587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:05.982688 10573 server_base.cc:1034] running on GCE node
W20260810 14:51:05.982592 10580 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:05.982595 10590 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:05.983003 10573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:05.983228 10573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:05.984364 10573 hybrid_clock.cc:648] HybridClock initialized: now 1786373465984354 us; error 29 us; skew 500 ppm
Aug 10 14:51:05 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:05.986768 10573 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:51:05.987197 10573 webserver.cc:460] Webserver started at http://127.19.29.194:36747/ using document root <none> and password file <none>
I20260810 14:51:05.987416 10573 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:05.987458 10573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:05.987574 10573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:05.988556 10573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "81b286a57d941e14b81d4f570e40e640"
server_key_iv: "588df643450328b7a535836e22babedd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.988873 10573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "81b286a57d941e14b81d4f570e40e640"
server_key_iv: "588df643450328b7a535836e22babedd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.990095 10573 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:05.990876 10607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:05.991039 10573 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260810 14:51:05.991135 10573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "81b286a57d941e14b81d4f570e40e640"
server_key_iv: "588df643450328b7a535836e22babedd"
server_key_version: "encryptionkey@0"
I20260810 14:51:05.991205 10573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.004719 10573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.006496 10573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.006629 10573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.006834 10573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:06.007130 10573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:06.007165 10573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.007194 10573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:06.007217 10573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.012814 10573 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38219
I20260810 14:51:06.012871 10805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38219 every 8 connection(s)
I20260810 14:51:06.013156 10573 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:51:06.018647 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 10573
I20260810 14:51:06.018731 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:51:06.018900 19575 external_mini_cluster.cc:1428] Setting key ab98ac8f57be343e9237657d246acc6a
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373465, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:06.022266 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.013830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:45473 (local address 127.19.29.254:44915)
0810 14:51:06.013884 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.013886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.014059 (+ 173us) server_negotiation.cc:407] Connection header received
0810 14:51:06.014803 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.014805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.014816 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.014872 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.015762 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.016352 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.017324 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.017520 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.017574 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.019718 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.019720 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.019720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.019728 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.020970 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.021399 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.021401 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.021401 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.021466 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.021670 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.021671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.021671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.021795 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.021857 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.022084 (+ 227us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.022177 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:51:06.022341 10811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.013778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:45473)
0810 14:51:06.013941 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.013982 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.014687 (+ 705us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.014930 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.014933 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.015479 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:06.015678 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.015682 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.016435 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.016437 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.017243 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.017246 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.017595 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.017595 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.017689 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.018088 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:06.018096 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:06.019630 (+ 1534us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:06.021056 (+ 1426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.021065 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.021067 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.021333 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.021525 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.021526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.021526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.021619 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.021856 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:06.021861 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:06.021972 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.022053 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.022165 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":86,"threads_started":1}
I20260810 14:51:06.022866 10807 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:06.022964 10807 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:06.023142 10807 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:06.023525 10226 ts_manager.cc:194] Registered new tserver with Master: 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.024019 10226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:45473
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:51:06.045419 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:06.125425 10815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:06.125624 10815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:06.125653 10815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:06.126765 10815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:06.126803 10815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:06.126837 10815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:51:06.128240 10815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:06.128463 10815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:06.128669 10815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:06.133437 10825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.133407 10829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.133443 10815 server_base.cc:1034] running on GCE node
W20260810 14:51:06.133417 10823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.133819 10815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:06.134058 10815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:06.135186 10815 hybrid_clock.cc:648] HybridClock initialized: now 1786373466135176 us; error 24 us; skew 500 ppm
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:06.137444 10815 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:51:06.137873 10815 webserver.cc:460] Webserver started at http://127.19.29.195:40427/ using document root <none> and password file <none>
I20260810 14:51:06.138078 10815 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:06.138124 10815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:06.138243 10815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:06.139236 10815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
format_stamp: "Formatted at 2026-08-10 14:51:06 on dist-test-slave-4tdj"
server_key: "232bfbced0aeaf547f560168a8dd4007"
server_key_iv: "352eff19841f7df42040c4b277add42d"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.139554 10815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
format_stamp: "Formatted at 2026-08-10 14:51:06 on dist-test-slave-4tdj"
server_key: "232bfbced0aeaf547f560168a8dd4007"
server_key_iv: "352eff19841f7df42040c4b277add42d"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.140775 10815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:06.141408 10844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.141556 10815 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:06.141638 10815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
format_stamp: "Formatted at 2026-08-10 14:51:06 on dist-test-slave-4tdj"
server_key: "232bfbced0aeaf547f560168a8dd4007"
server_key_iv: "352eff19841f7df42040c4b277add42d"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.141697 10815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.151518 10815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.153036 10815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.153158 10815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.153342 10815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:06.153615 10815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:06.153648 10815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.153673 10815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:06.153698 10815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.159214 10815 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:36779
I20260810 14:51:06.159252 11031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:36779 every 8 connection(s)
I20260810 14:51:06.159536 10815 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:51:06.160111 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 10815
I20260810 14:51:06.160202 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:51:06.160390 19575 external_mini_cluster.cc:1428] Setting key 0901d1e4fa84857e557c2b4282f76a2d
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:06.168386 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.160206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:41639 (local address 127.19.29.254:44915)
0810 14:51:06.160272 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.160274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.160510 (+ 236us) server_negotiation.cc:407] Connection header received
0810 14:51:06.161248 (+ 738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.161249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.161261 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.161311 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.162264 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.162842 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.163784 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.163980 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.164039 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.166226 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.166227 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.166228 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.166235 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.167344 (+ 1109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.167700 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.167701 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.167701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.167746 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.167923 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.167923 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.167924 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.168024 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.168068 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.168267 (+ 199us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.168323 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:51:06.168543 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.160168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:41639)
0810 14:51:06.160379 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.160428 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.161161 (+ 733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.161396 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.161400 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.161974 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:06.162163 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.162168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.162913 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.162914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.163696 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.163698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.164051 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.164051 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.164151 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.164657 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:06.164667 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:06.166147 (+ 1480us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:06.167411 (+ 1264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.167417 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.167419 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.167644 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.167789 (+ 145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.167790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.167790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.167882 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.168067 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:06.168070 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:06.168174 (+ 104us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.168248 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.168360 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":72,"threads_started":1}
I20260810 14:51:06.168979 11034 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:06.169070 11034 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:06.169210 11034 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:06.169554 10226 ts_manager.cc:194] Registered new tserver with Master: a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779)
I20260810 14:51:06.169911 10226 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:41639
I20260810 14:51:06.172194 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:51:06.178895 10340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.173471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34962 (local address 127.19.29.254:44915)
0810 14:51:06.173515 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.173517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.173628 (+ 111us) server_negotiation.cc:407] Connection header received
0810 14:51:06.173668 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.173669 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.173677 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.173722 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.174215 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.174707 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.175359 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.175541 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.175590 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.176651 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.176653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.176653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.176659 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.177782 (+ 1123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.178116 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.178117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.178117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.178166 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.178393 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.178394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.178394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.178545 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.178633 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.178740 (+ 107us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.178812 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:51:06.180382 10226 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:51:06.181903 10226 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:51:06.188210 11048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.184006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41137 (local address 127.0.0.1:60400)
0810 14:51:06.184396 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.184407 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.184465 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.184626 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.184627 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.184633 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.184710 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.184713 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.186371 (+ 1658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.186372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.187240 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.187243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.187926 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.187928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.188006 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.188019 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.188081 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.188134 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"mutex_wait_us":2,"thread_start_us":58,"threads_started":1}
I20260810 14:51:06.188222 11051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.184266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60400 (local address 127.19.29.193:41137)
0810 14:51:06.184436 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.184440 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.184453 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:51:06.184538 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.184540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.184556 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.184623 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.184791 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.185945 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.187322 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.187853 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.187915 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.187976 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.188102 (+ 126us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.188145 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":92,"threads_started":1}
I20260810 14:51:06.188540 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.184236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39958 (local address 127.19.29.195:36779)
0810 14:51:06.184484 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.184488 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.184497 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:51:06.184527 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.184528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.184540 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.184613 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.184822 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.185944 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.187375 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.188103 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.188172 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.188224 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.188424 (+ 200us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.188465 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":79,"threads_started":1}
I20260810 14:51:06.188530 11046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.183994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38219 (local address 127.0.0.1:38136)
0810 14:51:06.184336 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.184345 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.184383 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.184999 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.185000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.185002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.185039 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.185040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.185893 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.185894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.187273 (+ 1379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.187276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.188262 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.188264 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.188333 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.188339 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.188387 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.188430 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333,"mutex_wait_us":47,"thread_start_us":57,"threads_started":1}
I20260810 14:51:06.188530 11047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.183992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:36779 (local address 127.0.0.1:39958)
0810 14:51:06.184147 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.184182 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.184251 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.184622 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.184626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.184628 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.184694 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.184696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.186056 (+ 1360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.186056 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.187274 (+ 1218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.187276 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.188264 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.188265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.188333 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.188339 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.188394 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.188430 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":8,"thread_start_us":55,"threads_started":1}
I20260810 14:51:06.188851 11049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.184187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38136 (local address 127.19.29.194:38219)
0810 14:51:06.184819 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.184823 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.184832 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:51:06.184869 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.184871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.184887 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.184954 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.185144 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.185799 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.187377 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.188107 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.188172 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.188224 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.188725 (+ 501us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.188773 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":95,"threads_started":1}
I20260810 14:51:06.189321 10450 tablet_service.cc:1467] Processing CreateTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (DEFAULT_TABLE table=test-table [id=0753c5b313c043789507bfca599684e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.189297 10926 tablet_service.cc:1467] Processing CreateTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (DEFAULT_TABLE table=test-table [id=0753c5b313c043789507bfca599684e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.189644 10450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ea3fb97f7e42e991d3891ffd0d6d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.189653 10926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ea3fb97f7e42e991d3891ffd0d6d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.189585 10690 tablet_service.cc:1467] Processing CreateTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (DEFAULT_TABLE table=test-table [id=0753c5b313c043789507bfca599684e4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.189883 10690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c7ea3fb97f7e42e991d3891ffd0d6d10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.192162 11052 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap starting.
I20260810 14:51:06.192848 11053 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Bootstrap starting.
I20260810 14:51:06.192960 11052 tablet_bootstrap.cc:654] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.193509 11053 tablet_bootstrap.cc:654] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.193514 11052 log.cc:824] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.193939 11054 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Bootstrap starting.
I20260810 14:51:06.194056 11053 log.cc:824] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.194598 11054 tablet_bootstrap.cc:654] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.194815 11053 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: No bootstrap required, opened a new log
I20260810 14:51:06.194887 11053 ts_tablet_manager.cc:1397] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:06.195133 11054 log.cc:824] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.195672 11052 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: No bootstrap required, opened a new log
I20260810 14:51:06.195744 11052 ts_tablet_manager.cc:1397] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260810 14:51:06.195775 11054 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: No bootstrap required, opened a new log
I20260810 14:51:06.195873 11054 ts_tablet_manager.cc:1397] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:51:06.196779 11053 raft_consensus.cc:348] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.196945 11053 raft_consensus.cc:374] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.196980 11053 raft_consensus.cc:729] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76730c1247bd4ad99e54a22a9ea8eb3f, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.197263 11053 consensus_queue.cc:260] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.197219 11054 raft_consensus.cc:348] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.197363 11054 raft_consensus.cc:374] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.197405 11054 raft_consensus.cc:729] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5700891b96a466eaf0b2b2f6d97dca2, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.197512 11054 consensus_queue.cc:260] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.197572 11053 ts_tablet_manager.cc:1428] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:51:06.197613 11052 raft_consensus.cc:348] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.197711 10807 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
I20260810 14:51:06.197753 11052 raft_consensus.cc:374] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.197780 11054 ts_tablet_manager.cc:1428] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:51:06.197789 11052 raft_consensus.cc:729] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.197819 11034 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
I20260810 14:51:06.197889 11052 consensus_queue.cc:260] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.198135 11052 ts_tablet_manager.cc:1428] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:06.198205 10562 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
W20260810 14:51:06.263715 10808 tablet.cc:2369] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:51:06.306447 11064 raft_consensus.cc:482] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:06.306607 11064 raft_consensus.cc:504] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.307005 11064 leader_election.cc:288] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.309669 10566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.307168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:36779 (local address 127.19.29.193:47217)
0810 14:51:06.307212 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.307223 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.307262 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.307486 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.307487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.307489 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.307560 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.307562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.308163 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.308164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.308880 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.308882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.309414 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.309415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.309493 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.309496 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.309543 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.309585 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 14:51:06.309659 11050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.307311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:47217 (local address 127.19.29.195:36779)
0810 14:51:06.307363 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.307365 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.307373 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:06.307397 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.307398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.307405 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.307473 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.307625 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.308088 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.308971 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.309341 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.309402 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.309411 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.309555 (+ 144us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.309594 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:51:06.309813 11049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.307258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:41229 (local address 127.19.29.194:38219)
0810 14:51:06.307324 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.307326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.307535 (+ 209us) server_negotiation.cc:407] Connection header received
0810 14:51:06.307590 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.307591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.307602 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.307649 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.307784 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.308251 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.309157 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.309518 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.309579 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.309587 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.309717 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.309749 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:51:06.309821 11065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.307168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38219 (local address 127.19.29.193:41229)
0810 14:51:06.307471 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.307479 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.307538 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.307657 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.307658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.307659 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.307728 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.307730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.308325 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.308326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.309069 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.309071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.309594 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.309595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.309657 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.309660 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.309703 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.309739 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"mutex_wait_us":138,"thread_start_us":100,"threads_started":1}
I20260810 14:51:06.310070 10959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ea3fb97f7e42e991d3891ffd0d6d10" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" is_pre_election: true
I20260810 14:51:06.310251 10959 raft_consensus.cc:2454] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 0.
I20260810 14:51:06.310248 10728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ea3fb97f7e42e991d3891ffd0d6d10" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" is_pre_election: true
I20260810 14:51:06.310427 10728 raft_consensus.cc:2454] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 0.
I20260810 14:51:06.310595 10375 leader_election.cc:302] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d, a5700891b96a466eaf0b2b2f6d97dca2; no voters:
I20260810 14:51:06.310750 11064 raft_consensus.cc:2781] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:51:06.310797 11064 raft_consensus.cc:482] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:51:06.310817 11064 raft_consensus.cc:3037] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.311522 11064 raft_consensus.cc:504] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.311645 11064 leader_election.cc:288] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 election: Requested vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.311802 10959 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ea3fb97f7e42e991d3891ffd0d6d10" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
I20260810 14:51:06.311822 10728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c7ea3fb97f7e42e991d3891ffd0d6d10" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
I20260810 14:51:06.311885 10728 raft_consensus.cc:3037] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.311887 10959 raft_consensus.cc:3037] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.312569 10728 raft_consensus.cc:2454] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 1.
I20260810 14:51:06.312656 10959 raft_consensus.cc:2454] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 1.
I20260810 14:51:06.312740 10371 leader_election.cc:302] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d, 76730c1247bd4ad99e54a22a9ea8eb3f; no voters:
I20260810 14:51:06.312830 11064 raft_consensus.cc:2781] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:06.312973 11064 raft_consensus.cc:686] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 LEADER]: Becoming Leader. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Running, Role: LEADER
I20260810 14:51:06.313051 11064 consensus_queue.cc:237] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.313911 10226 catalog_manager.cc:5495] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193). New cstate: current_term: 1 leader_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } health_report { overall_health: HEALTHY } } }
I20260810 14:51:06.334154 11051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.331952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60404 (local address 127.19.29.193:41137)
0810 14:51:06.332004 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.332006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.332014 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:06.332069 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.332070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.332086 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.332146 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:06.332270 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.332740 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.333452 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.333639 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.333693 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.333836 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:06.333931 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:51:06.334000 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.334047 (+ 47us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.334067 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:51:06.335801 10959 raft_consensus.cc:1261] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Refusing update from remote peer 43b4158eaa1c45fc9c5a0d4881f32a6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:06.335809 10728 raft_consensus.cc:1261] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Refusing update from remote peer 43b4158eaa1c45fc9c5a0d4881f32a6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:06.336139 11064 consensus_queue.cc:1035] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:06.336275 11068 consensus_queue.cc:1035] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:06.339632 11076 mvcc.cc:205] Tried to move back new op lower bound from 7316985718108925952 to 7316985718018940928. Current Snapshot: MvccSnapshot[applied={T|T < 7316985718108925952 or (T in {7316985718108925952})}]
I20260810 14:51:06.340627 10226 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:06.340710 10226 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:06.341347 10226 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Sending DeleteTablet for 3 replicas of tablet c7ea3fb97f7e42e991d3891ffd0d6d10
I20260810 14:51:06.341714 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 10344
I20260810 14:51:06.341742 10926 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:06 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:39958
I20260810 14:51:06.341750 10450 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:06 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60400
I20260810 14:51:06.341953 10690 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:06 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:38136
I20260810 14:51:06.351891 11089 tablet_replica.cc:330] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: stopping tablet replica
I20260810 14:51:06.352065 11089 raft_consensus.cc:2229] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:06.352238 11089 raft_consensus.cc:2258] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:06.353170 11089 ts_tablet_manager.cc:1905] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:06.355096 11089 ts_tablet_manager.cc:1918] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:06.355168 11089 log.cc:1196] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/c7ea3fb97f7e42e991d3891ffd0d6d10
I20260810 14:51:06.355378 11089 ts_tablet_manager.cc:1939] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting consensus metadata
I20260810 14:51:06.356350 10197 catalog_manager.cc:4841] TS 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (table test-table [id=0753c5b313c043789507bfca599684e4]) successfully deleted
I20260810 14:51:06.358785 11088 tablet_replica.cc:330] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: stopping tablet replica
I20260810 14:51:06.358959 11088 raft_consensus.cc:2229] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:06.359078 11088 raft_consensus.cc:2258] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:06.359562 11088 ts_tablet_manager.cc:1905] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:06.361047 11088 ts_tablet_manager.cc:1918] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:06.361137 11088 log.cc:1196] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/c7ea3fb97f7e42e991d3891ffd0d6d10
I20260810 14:51:06.361419 11088 ts_tablet_manager.cc:1939] T c7ea3fb97f7e42e991d3891ffd0d6d10 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting consensus metadata
I20260810 14:51:06.361831 10208 catalog_manager.cc:4841] TS a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (table test-table [id=0753c5b313c043789507bfca599684e4]) successfully deleted
W20260810 14:51:06.363610 10202 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:41137 (error 108)
I20260810 14:51:06.363929 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 10573
I20260810 14:51:06.364090 11048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.363946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41137 (local address 127.0.0.1:60416)
0810 14:51:06.364009 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.364054 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260810 14:51:06.365572 10202 catalog_manager.cc:4584] TS 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193:41137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c7ea3fb97f7e42e991d3891ffd0d6d10: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41137: connect: Connection refused (error 111)
I20260810 14:51:06.379525 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 10815
I20260810 14:51:06.397085 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 10173
I20260810 14:51:06.407625 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--webserver_interface=127.19.29.254
--webserver_port=41247
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:44915
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:06.488337 11093 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:06.488530 11093 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:06.488551 11093 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:06.489667 11093 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:06.489707 11093 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:06.489720 11093 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:06.489744 11093 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:06.489768 11093 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:06.491246 11093 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:44915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=41247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11093
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:06.491459 11093 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:06.491672 11093 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:06.501433 11106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.501539 11093 server_base.cc:1034] running on GCE node
W20260810 14:51:06.501407 11110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.501402 11105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.501927 11093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:06.502215 11093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:06.503357 11093 hybrid_clock.cc:648] HybridClock initialized: now 1786373466503356 us; error 36 us; skew 500 ppm
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:06.505753 11093 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:06.506181 11093 webserver.cc:460] Webserver started at http://127.19.29.254:41247/ using document root <none> and password file <none>
I20260810 14:51:06.506422 11093 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:06.506487 11093 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:06.507766 11093 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:06.508353 11121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.508509 11093 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:06.508601 11093 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "eb8db1e1ff8b41f1be5c15ba36849110"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "d58bd0ad5708337a626265466486aad8"
server_key_iv: "2906bef583738bec6323feeffe3a7078"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.508955 11093 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.538354 11093 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.540186 11093 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.540318 11093 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.544209 11093 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:44915
I20260810 14:51:06.544251 11209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:44915 every 8 connection(s)
I20260810 14:51:06.544617 11093 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:06.546231 11211 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:51:06.546942 11211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap starting.
I20260810 14:51:06.552723 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 11093
I20260810 14:51:06.552978 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:41137
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=42887
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:06.555856 11211 log.cc:824] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.557699 11211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:06.557963 11211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap complete.
I20260810 14:51:06.560150 11211 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:06.560374 11211 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.560540 11211 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:06.560618 11211 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:06.560672 11211 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:06.560719 11211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:51:06.561687 11211 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:06.561787 11211 leader_election.cc:302] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb8db1e1ff8b41f1be5c15ba36849110; no voters:
I20260810 14:51:06.561939 11211 leader_election.cc:288] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:51:06.561993 11218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:51:06.562114 11218 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 LEADER]: Becoming Leader. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Running, Role: LEADER
I20260810 14:51:06.562211 11211 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:06.562311 11218 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:06.562669 11221 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb8db1e1ff8b41f1be5c15ba36849110. Latest consensus state: current_term: 2 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:06.562676 11219 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:06.562767 11221 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:06.562786 11219 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:06.563184 11231 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:06.563944 11231 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:06.564106 11231 catalog_manager.cc:1259] Loaded cluster ID: e9f45839b9cf42aab82e387fe092236d
I20260810 14:51:06.564306 11231 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:51:06.564594 11231 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260810 14:51:06.569160 11231 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260810 14:51:06.571521 11231 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:51:06.571719 11231 catalog_manager.cc:5879] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Loaded TSK: 0
I20260810 14:51:06.571940 11231 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:51:06.635368 11214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:06.635562 11214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:06.635593 11214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:06.636684 11214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:06.636721 11214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:06.636754 11214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:51:06.638211 11214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:41137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=42887
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:06.638451 11214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:06.638657 11214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:06.643404 11251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.643386 11252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.643395 11257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.643563 11214 server_base.cc:1034] running on GCE node
I20260810 14:51:06.643865 11214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:06.644151 11214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:06.645335 11214 hybrid_clock.cc:648] HybridClock initialized: now 1786373466645315 us; error 33 us; skew 500 ppm
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:06.648335 11214 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:51:06.648870 11214 webserver.cc:460] Webserver started at http://127.19.29.193:42887/ using document root <none> and password file <none>
I20260810 14:51:06.649127 11214 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:06.649206 11214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:06.650856 11214 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:06.651634 11264 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.651793 11214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:06.651857 11214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "b2925629855d5d695b68ca97e59360ca"
server_key_iv: "a04e99533c5d5c224c62117d25d397cd"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.652191 11214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.661971 11214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.663977 11214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.664108 11214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.664301 11214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:06.664690 11277 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:51:06.666653 11214 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:51:06.666711 11214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 14:51:06.666744 11214 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:51:06.667371 11214 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:51:06.667405 11214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 14:51:06.667500 11277 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap starting.
I20260810 14:51:06.674553 11214 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41137
I20260810 14:51:06.674626 11449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41137 every 8 connection(s)
I20260810 14:51:06.675091 11214 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:51:06.678393 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 11214
I20260810 14:51:06.678674 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:38219
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=36747
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:06.679232 11277 log.cc:824] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.683084 11277 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:06.683401 11277 tablet_bootstrap.cc:492] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap complete.
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:06.684754 11277 ts_tablet_manager.cc:1397] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.013s
I20260810 14:51:06.686218 11277 raft_consensus.cc:348] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.686676 11277 raft_consensus.cc:729] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.686892 11277 consensus_queue.cc:260] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.687224 11277 ts_tablet_manager.cc:1428] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:06.689358 11455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.675877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:56943)
0810 14:51:06.676059 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.676102 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.676666 (+ 564us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.677171 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.677175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.677529 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:06.677770 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.677776 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.679544 (+ 1768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.679546 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.680440 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.680443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.681368 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.681370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.681512 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.683382 (+ 1870us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:06.683391 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:06.685303 (+ 1912us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:06.687604 (+ 2301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.687608 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.687610 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.687887 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.688182 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.688183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.688183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.688298 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.688729 (+ 431us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:06.688733 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:06.688875 (+ 142us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.688971 (+ 96us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.689151 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":101,"threads_started":1}
I20260810 14:51:06.689399 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.676247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56943 (local address 127.19.29.254:44915)
0810 14:51:06.676422 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.676435 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.676474 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:51:06.676908 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.676917 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.676980 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.677146 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.677903 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.679438 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.680539 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.681149 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.681250 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.685437 (+ 4187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.685442 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.685442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.685457 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.687514 (+ 2057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.687977 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.687981 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.687981 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.688113 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.688358 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.688359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.688359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.688661 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.688750 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.689055 (+ 305us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.689201 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
I20260810 14:51:06.690565 11451 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:06.690656 11451 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:06.690814 11451 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:06.691525 11144 ts_manager.cc:194] Registered new tserver with Master: 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193:41137)
I20260810 14:51:06.692732 11144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:56943
I20260810 14:51:06.693924 11451 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
I20260810 14:51:06.697659 11465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.693131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41137 (local address 127.0.0.1:60420)
0810 14:51:06.694514 (+ 1383us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.694541 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.694614 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.694784 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.694787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.694789 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.694850 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.694852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.695971 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.695972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.696763 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.696765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.697371 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.697372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.697451 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.697463 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.697532 (+ 69us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.697588 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1360,"thread_start_us":84,"threads_started":1}
I20260810 14:51:06.697656 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.693202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60420 (local address 127.19.29.193:41137)
0810 14:51:06.694409 (+ 1207us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.694414 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.694619 (+ 205us) server_negotiation.cc:407] Connection header received
0810 14:51:06.694698 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.694700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.694717 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.694782 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.694927 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.695893 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.696851 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.697298 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.697358 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.697412 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.697560 (+ 148us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.697596 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1171,"thread_start_us":82,"threads_started":1}
I20260810 14:51:06.698094 11311 tablet_service.cc:1514] Processing DeleteTablet for tablet c7ea3fb97f7e42e991d3891ffd0d6d10 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:06 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:60420
I20260810 14:51:06.698557 11467 tablet_replica.cc:330] stopping tablet replica
I20260810 14:51:06.698650 11467 raft_consensus.cc:2229] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:06.698714 11467 raft_consensus.cc:2258] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:06.698974 11467 ts_tablet_manager.cc:1905] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:06.700955 11467 ts_tablet_manager.cc:1918] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:06.701032 11467 log.cc:1196] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/c7ea3fb97f7e42e991d3891ffd0d6d10
I20260810 14:51:06.701227 11467 ts_tablet_manager.cc:1939] T c7ea3fb97f7e42e991d3891ffd0d6d10 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Deleting consensus metadata
I20260810 14:51:06.701704 11126 catalog_manager.cc:4841] TS 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193:41137): tablet c7ea3fb97f7e42e991d3891ffd0d6d10 (table test-table [id=0753c5b313c043789507bfca599684e4]) successfully deleted
W20260810 14:51:06.764446 11462 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:06.764649 11462 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:06.764680 11462 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:06.765800 11462 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:06.765839 11462 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:06.765873 11462 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:51:06.767362 11462 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:38219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=36747
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11462
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:06.767601 11462 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:06.767805 11462 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:06.772740 11478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.772737 11481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.772871 11462 server_base.cc:1034] running on GCE node
W20260810 14:51:06.772733 11477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.773212 11462 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:06.773456 11462 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:06.774593 11462 hybrid_clock.cc:648] HybridClock initialized: now 1786373466774577 us; error 31 us; skew 500 ppm
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:06.776952 11462 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:51:06.777352 11462 webserver.cc:460] Webserver started at http://127.19.29.194:36747/ using document root <none> and password file <none>
I20260810 14:51:06.777558 11462 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:06.777622 11462 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:06.778903 11462 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:06.779430 11491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.779569 11462 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:06.779655 11462 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "81b286a57d941e14b81d4f570e40e640"
server_key_iv: "588df643450328b7a535836e22babedd"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.779950 11462 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.787173 11462 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.788790 11462 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.788905 11462 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.789088 11462 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:06.789348 11462 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:06.789381 11462 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.789407 11462 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:06.789430 11462 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.794946 11462 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38219
I20260810 14:51:06.795003 11684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38219 every 8 connection(s)
I20260810 14:51:06.795348 11462 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:06.803047 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.795978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:33865 (local address 127.19.29.254:44915)
0810 14:51:06.796020 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.796022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.796226 (+ 204us) server_negotiation.cc:407] Connection header received
0810 14:51:06.796665 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.796666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.796681 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.796728 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.797573 (+ 845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.798059 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.798948 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.799148 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.799197 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.800967 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.800969 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.800969 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.800975 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.802013 (+ 1038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.802375 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.802376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.802376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.802424 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.802589 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.802590 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.802590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.802679 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.802722 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.802910 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.802974 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:51:06.803195 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.795959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:33865)
0810 14:51:06.796123 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.796156 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.796588 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.796778 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.796781 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.797325 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:06.797501 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.797506 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.798121 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.798122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.798889 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.798891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.799205 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.799205 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.799295 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.799660 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:06.799668 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:06.800892 (+ 1224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:06.802073 (+ 1181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.802080 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.802088 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.802285 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.802463 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.802463 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.802463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.802550 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.802720 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:06.802723 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:06.802822 (+ 99us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.802896 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.803004 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260810 14:51:06.803630 11685 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:06.803710 11685 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:06.803865 11685 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:06.804206 11144 ts_manager.cc:194] Registered new tserver with Master: 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.804566 11144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:33865
I20260810 14:51:06.804870 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 11462
I20260810 14:51:06.805160 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:36779
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=40427
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:06.886245 11697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:06.886451 11697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:06.886471 11697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:06.887574 11697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:06.887614 11697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:06.887641 11697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:51:06.889068 11697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:36779
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=40427
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:06.889263 11697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:06.889451 11697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:51:06.894464 11697 server_base.cc:1034] running on GCE node
W20260810 14:51:06.894393 11709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.894433 11708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:06.894405 11713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:06.894860 11697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:06.895098 11697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:06.896235 11697 hybrid_clock.cc:648] HybridClock initialized: now 1786373466896220 us; error 29 us; skew 500 ppm
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:06.898522 11697 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:51:06.898921 11697 webserver.cc:460] Webserver started at http://127.19.29.195:40427/ using document root <none> and password file <none>
I20260810 14:51:06.899113 11697 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:06.899165 11697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:06.900346 11697 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:06.900856 11726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.901005 11697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.901072 11697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
format_stamp: "Formatted at 2026-08-10 14:51:06 on dist-test-slave-4tdj"
server_key: "232bfbced0aeaf547f560168a8dd4007"
server_key_iv: "352eff19841f7df42040c4b277add42d"
server_key_version: "encryptionkey@0"
I20260810 14:51:06.901384 11697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:06.909785 11697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:06.911773 11697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:06.911901 11697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:06.912108 11697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:06.912391 11697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:06.912423 11697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.912451 11697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:06.912473 11697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:06.917932 11697 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:36779
I20260810 14:51:06.918002 11918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:36779 every 8 connection(s)
I20260810 14:51:06.918277 11697 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:51:06.923089 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 11697
Aug 10 14:51:06 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373466, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:06.927291 11457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.918989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:55539 (local address 127.19.29.254:44915)
0810 14:51:06.919072 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.919074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.919275 (+ 201us) server_negotiation.cc:407] Connection header received
0810 14:51:06.919714 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.919715 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.919726 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.919782 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.920611 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.921100 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.921992 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.922177 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.922233 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.924516 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.924517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.924517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.924525 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.925986 (+ 1461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.926429 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.926430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.926430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.926481 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.926718 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.926719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.926719 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.926846 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.926917 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.927132 (+ 215us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.927204 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 14:51:06.927367 11921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.918974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:55539)
0810 14:51:06.919157 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.919191 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.919635 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.919833 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.919836 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.920365 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:06.920542 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.920546 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.921164 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.921165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.921922 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.921924 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.922238 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.922238 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.922360 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.922760 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:06.922767 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:06.924436 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:06.926050 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.926058 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.926060 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.926362 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.926544 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:06.926545 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:06.926545 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:06.926656 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:06.926907 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:06.926910 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:06.927019 (+ 109us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.927094 (+ 75us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.927203 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260810 14:51:06.927819 11919 heartbeater.cc:347] Connected to a master server at 127.19.29.254:44915
I20260810 14:51:06.927922 11919 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:06.928114 11919 heartbeater.cc:511] Master 127.19.29.254:44915 requested a full tablet report, sending...
I20260810 14:51:06.928470 11144 ts_manager.cc:194] Registered new tserver with Master: a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779)
I20260810 14:51:06.928817 11144 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:55539
I20260810 14:51:06.929776 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.923479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.19.29.254:44915)
0810 14:51:06.923607 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.923609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.923637 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:51:06.923711 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.923712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.923725 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.923801 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:06.924355 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.924883 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.925873 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.926087 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.926164 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.927340 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:06.927342 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:06.927342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:06.927349 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:06.928799 (+ 1450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.929100 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.929101 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.929101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.929158 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:06.929317 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:06.929317 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:06.929318 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:06.929415 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:06.929574 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.929620 (+ 46us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.929688 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":71,"threads_started":1}
I20260810 14:51:06.930423 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:51:06.932824 11923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.930707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.19.29.254:44915)
0810 14:51:06.930756 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.930757 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.930796 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:51:06.930865 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.930865 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.930900 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.930955 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:06.931041 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.931473 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.932155 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.932356 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.932406 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.932552 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:06.932645 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:51:06.932711 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.932747 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.932767 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:51:06.933079 11144 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:34982:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:51:06.934582 11144 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:51:06.936455 11311 tablet_service.cc:1467] Processing CreateTablet for tablet 35f148f83f1442d09e18b32d94d47ae1 (DEFAULT_TABLE table=test-table [id=3717224912a04ce19583309c6a768e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.936655 11311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f148f83f1442d09e18b32d94d47ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.938218 11277 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap starting.
I20260810 14:51:06.938534 11277 tablet_bootstrap.cc:654] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.939066 11277 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: No bootstrap required, opened a new log
I20260810 14:51:06.939119 11277 ts_tablet_manager.cc:1397] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:06.939220 11277 raft_consensus.cc:348] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.939291 11277 raft_consensus.cc:374] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.939337 11277 raft_consensus.cc:729] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.939380 11277 consensus_queue.cc:260] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.939478 11277 ts_tablet_manager.cc:1428] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:06.939695 11465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.936207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38219 (local address 127.0.0.1:38142)
0810 14:51:06.936342 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.936352 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.936391 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.936924 (+ 533us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.936925 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.936926 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.936960 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.936961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.937809 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.937810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.938618 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.938620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.939470 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.939471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.939544 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.939549 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.939581 (+ 32us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.939617 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120}
I20260810 14:51:06.939978 11927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.936374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39974 (local address 127.19.29.195:36779)
0810 14:51:06.936533 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.936538 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.936548 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:51:06.936581 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.936583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.936597 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.936669 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.936804 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.937737 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.939001 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.939629 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.939698 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.939756 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.939862 (+ 106us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.939905 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":67,"threads_started":1}
I20260810 14:51:06.940169 11926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.936209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:36779 (local address 127.0.0.1:39974)
0810 14:51:06.936373 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.936383 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.936427 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.936673 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.936674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.936676 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.936715 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.936716 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.937915 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.937916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.938937 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.938940 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.939699 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.939700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.939757 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.939761 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.940064 (+ 303us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.940106 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":20,"thread_start_us":93,"threads_started":1}
I20260810 14:51:06.940241 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.936476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38142 (local address 127.19.29.194:38219)
0810 14:51:06.936782 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.936786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.936794 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:06.936831 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.936832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.936847 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.936916 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.937027 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.937722 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.938691 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.939371 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.939985 (+ 614us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.940106 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.940130 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.940167 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":270,"thread_start_us":86,"threads_started":1}
I20260810 14:51:06.940771 11572 tablet_service.cc:1467] Processing CreateTablet for tablet 35f148f83f1442d09e18b32d94d47ae1 (DEFAULT_TABLE table=test-table [id=3717224912a04ce19583309c6a768e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.940789 11808 tablet_service.cc:1467] Processing CreateTablet for tablet 35f148f83f1442d09e18b32d94d47ae1 (DEFAULT_TABLE table=test-table [id=3717224912a04ce19583309c6a768e25]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:06.941057 11808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f148f83f1442d09e18b32d94d47ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.941059 11572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 35f148f83f1442d09e18b32d94d47ae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:06.943641 11930 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Bootstrap starting.
I20260810 14:51:06.944186 11930 tablet_bootstrap.cc:654] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.944653 11930 log.cc:824] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.944927 11931 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Bootstrap starting.
I20260810 14:51:06.945478 11930 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: No bootstrap required, opened a new log
I20260810 14:51:06.945554 11930 ts_tablet_manager.cc:1397] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:51:06.945586 11931 tablet_bootstrap.cc:654] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:06.946105 11931 log.cc:824] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:06.946969 11931 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: No bootstrap required, opened a new log
I20260810 14:51:06.947041 11931 ts_tablet_manager.cc:1397] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:51:06.947381 11930 raft_consensus.cc:348] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.947539 11930 raft_consensus.cc:374] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.947577 11930 raft_consensus.cc:729] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76730c1247bd4ad99e54a22a9ea8eb3f, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.947703 11930 consensus_queue.cc:260] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.947985 11930 ts_tablet_manager.cc:1428] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:51:06.947983 11685 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
I20260810 14:51:06.948890 11931 raft_consensus.cc:348] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.949019 11931 raft_consensus.cc:374] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:06.949064 11931 raft_consensus.cc:729] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5700891b96a466eaf0b2b2f6d97dca2, State: Initialized, Role: FOLLOWER
I20260810 14:51:06.949182 11931 consensus_queue.cc:260] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.949416 11931 ts_tablet_manager.cc:1428] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260810 14:51:06.949456 11919 heartbeater.cc:503] Master 127.19.29.254:44915 was elected leader, sending a full tablet report...
I20260810 14:51:06.985599 11463 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:06.985707 11463 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.985978 11463 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.988583 11455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.986128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38219 (local address 127.19.29.193:37573)
0810 14:51:06.986180 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.986190 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.986229 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.986399 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.986401 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.986403 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.986470 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.986472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.987090 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.987091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.987830 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.987832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.988348 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.988349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.988423 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.988426 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.988470 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.988509 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31,"mutex_wait_us":24}
I20260810 14:51:06.988585 11928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.986219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:37573 (local address 127.19.29.194:38219)
0810 14:51:06.986259 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.986262 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.986269 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:51:06.986310 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.986312 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.986321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.986381 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.986532 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.987023 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.987906 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.988283 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.988344 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.988353 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.988496 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.988529 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:51:06.988673 11927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.986215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:46465 (local address 127.19.29.195:36779)
0810 14:51:06.986259 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.986261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.986422 (+ 161us) server_negotiation.cc:407] Connection header received
0810 14:51:06.986455 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.986457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.986466 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.986514 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:06.986669 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.987122 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.988001 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.988366 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.988426 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.988434 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.988571 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.988610 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:51:06.988708 11939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.986129 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:36779 (local address 127.19.29.193:46465)
0810 14:51:06.986359 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:06.986367 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:06.986414 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:06.986521 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:06.986521 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:06.986522 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:06.986613 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.986615 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.987187 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.987188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.987923 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:06.987925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.988449 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.988450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:06.988515 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.988518 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:06.988560 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:51:06.988606 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":68,"thread_start_us":117,"threads_started":1}
I20260810 14:51:06.988942 11606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f148f83f1442d09e18b32d94d47ae1" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" is_pre_election: true
I20260810 14:51:06.989094 11606 raft_consensus.cc:2454] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 0.
I20260810 14:51:06.989331 11268 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d, 76730c1247bd4ad99e54a22a9ea8eb3f; no voters:
I20260810 14:51:06.989382 11837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f148f83f1442d09e18b32d94d47ae1" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" is_pre_election: true
I20260810 14:51:06.989513 11837 raft_consensus.cc:2454] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 0.
I20260810 14:51:06.989542 11463 raft_consensus.cc:2781] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:51:06.989614 11463 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:51:06.989643 11463 raft_consensus.cc:3037] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.990379 11463 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.990507 11463 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 election: Requested vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
I20260810 14:51:06.990639 11837 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f148f83f1442d09e18b32d94d47ae1" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
I20260810 14:51:06.990657 11606 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35f148f83f1442d09e18b32d94d47ae1" candidate_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
I20260810 14:51:06.990708 11837 raft_consensus.cc:3037] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.990725 11606 raft_consensus.cc:3037] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:06.991346 11837 raft_consensus.cc:2454] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 1.
I20260810 14:51:06.991449 11606 raft_consensus.cc:2454] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 43b4158eaa1c45fc9c5a0d4881f32a6d in term 1.
I20260810 14:51:06.991518 11270 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d, a5700891b96a466eaf0b2b2f6d97dca2; no voters:
I20260810 14:51:06.991631 11463 raft_consensus.cc:2781] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:06.991784 11463 raft_consensus.cc:686] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 LEADER]: Becoming Leader. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Running, Role: LEADER
I20260810 14:51:06.991849 11463 consensus_queue.cc:237] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:06.992624 11143 catalog_manager.cc:5495] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193). New cstate: current_term: 1 leader_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } health_report { overall_health: HEALTHY } } }
I20260810 14:51:06.997236 11466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:06.995491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.19.29.193:41137)
0810 14:51:06.995540 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:06.995542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:06.995548 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:51:06.995573 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:06.995574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:06.995589 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:06.995641 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:06.995728 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.996137 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.996742 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:06.996903 (+ 161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:06.996941 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:06.997027 (+ 86us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:06.997107 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:51:06.997150 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:06.997178 (+ 28us) server_negotiation.cc:299] Negotiation successful
0810 14:51:06.997192 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:51:06.998510 11606 raft_consensus.cc:1261] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Refusing update from remote peer 43b4158eaa1c45fc9c5a0d4881f32a6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:06.998521 11837 raft_consensus.cc:1261] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Refusing update from remote peer 43b4158eaa1c45fc9c5a0d4881f32a6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:06.998782 11463 consensus_queue.cc:1035] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:06.998907 11940 consensus_queue.cc:1035] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:07.001061 11947 mvcc.cc:205] Tried to move back new op lower bound from 7316985720823844864 to 7316985720799203328. Current Snapshot: MvccSnapshot[applied={T|T < 7316985720823844864}]
I20260810 14:51:07.003388 11143 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:34982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:07.003468 11143 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:34982:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:07.004149 11143 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Sending DeleteTablet for 3 replicas of tablet 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:07.004458 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 11214
I20260810 14:51:07.004451 11572 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f148f83f1442d09e18b32d94d47ae1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:07 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:38142
I20260810 14:51:07.014628 11961 tablet_replica.cc:330] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: stopping tablet replica
I20260810 14:51:07.014802 11961 raft_consensus.cc:2229] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:07.014940 11961 raft_consensus.cc:2258] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:07.016281 11961 ts_tablet_manager.cc:1905] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:07.017894 11961 ts_tablet_manager.cc:1918] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:07.017972 11961 log.cc:1196] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:07.018246 11961 ts_tablet_manager.cc:1939] T 35f148f83f1442d09e18b32d94d47ae1 P 76730c1247bd4ad99e54a22a9ea8eb3f: Deleting consensus metadata
I20260810 14:51:07.034621 11808 tablet_service.cc:1514] Processing DeleteTablet for tablet 35f148f83f1442d09e18b32d94d47ae1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:07 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:39974
I20260810 14:51:07.035279 11962 tablet_replica.cc:330] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: stopping tablet replica
I20260810 14:51:07.035406 11962 raft_consensus.cc:2229] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:07.035519 11962 raft_consensus.cc:2258] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:07.036361 11125 catalog_manager.cc:4841] TS 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): tablet 35f148f83f1442d09e18b32d94d47ae1 (table test-table [id=3717224912a04ce19583309c6a768e25]) successfully deleted
I20260810 14:51:07.036589 11962 ts_tablet_manager.cc:1905] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:07.038316 11962 ts_tablet_manager.cc:1918] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:07.038409 11962 log.cc:1196] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:07.038690 11962 ts_tablet_manager.cc:1939] T 35f148f83f1442d09e18b32d94d47ae1 P a5700891b96a466eaf0b2b2f6d97dca2: Deleting consensus metadata
I20260810 14:51:07.039268 11127 catalog_manager.cc:4841] TS a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): tablet 35f148f83f1442d09e18b32d94d47ae1 (table test-table [id=3717224912a04ce19583309c6a768e25]) successfully deleted
W20260810 14:51:07.042769 11126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:41137 (error 108)
I20260810 14:51:07.043036 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 11462
I20260810 14:51:07.043311 11926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.043211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41137 (local address 127.0.0.1:60430)
0810 14:51:07.043254 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.043282 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260810 14:51:07.043406 11126 catalog_manager.cc:4584] TS 43b4158eaa1c45fc9c5a0d4881f32a6d (127.19.29.193:41137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 35f148f83f1442d09e18b32d94d47ae1: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41137: connect: Connection refused (error 111)
I20260810 14:51:07.057626 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 11697
I20260810 14:51:07.069860 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 11093
I20260810 14:51:07.080916 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--webserver_interface=127.19.29.254
--webserver_port=41247
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:44915
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:07.161721 11965 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:07.161926 11965 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:07.161947 11965 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:07.163167 11965 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:07.163209 11965 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:07.163223 11965 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:07.163233 11965 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:07.163244 11965 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:07.164755 11965 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:44915
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44915
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=41247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11965
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:07.164985 11965 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:07.165244 11965 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:07.169860 11975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.169938 11965 server_base.cc:1034] running on GCE node
W20260810 14:51:07.169888 11973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.169886 11972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.170409 11965 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:07.170701 11965 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:07.171847 11965 hybrid_clock.cc:648] HybridClock initialized: now 1786373467171834 us; error 27 us; skew 500 ppm
Aug 10 14:51:07 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:07.174265 11965 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:07.174721 11965 webserver.cc:460] Webserver started at http://127.19.29.254:41247/ using document root <none> and password file <none>
I20260810 14:51:07.174916 11965 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:07.174964 11965 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:07.176239 11965 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:07.176952 11983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.177096 11965 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:07.177182 11965 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "eb8db1e1ff8b41f1be5c15ba36849110"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "d58bd0ad5708337a626265466486aad8"
server_key_iv: "2906bef583738bec6323feeffe3a7078"
server_key_version: "encryptionkey@0"
I20260810 14:51:07.177510 11965 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:07.188292 11965 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:07.190358 11965 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:07.190493 11965 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:07.194235 11965 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:44915
I20260810 14:51:07.194280 12074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:44915 every 8 connection(s)
I20260810 14:51:07.194669 11965 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:07.195595 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 11965
I20260810 14:51:07.195863 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:41137
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=42887
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:07.196376 12075 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:51:07.197041 12075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap starting.
I20260810 14:51:07.206053 12075 log.cc:824] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:07.208365 12075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:07.208642 12075 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: Bootstrap complete.
I20260810 14:51:07.210786 12075 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:07.211010 12075 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Initialized, Role: FOLLOWER
I20260810 14:51:07.211162 12075 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:07.211243 12075 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:07.211297 12075 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:07.211346 12075 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:51:07.212314 12075 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:07.212416 12075 leader_election.cc:302] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb8db1e1ff8b41f1be5c15ba36849110; no voters:
I20260810 14:51:07.212586 12075 leader_election.cc:288] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 14:51:07.212634 12080 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 3 FOLLOWER]: Leader election won for term 3
I20260810 14:51:07.212762 12080 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [term 3 LEADER]: Becoming Leader. State: Replica: eb8db1e1ff8b41f1be5c15ba36849110, State: Running, Role: LEADER
I20260810 14:51:07.212859 12075 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:07.212868 12080 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } }
I20260810 14:51:07.213279 12081 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb8db1e1ff8b41f1be5c15ba36849110. Latest consensus state: current_term: 3 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:07.213594 12081 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:07.213263 12085 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb8db1e1ff8b41f1be5c15ba36849110" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44915 } } }
I20260810 14:51:07.213763 12085 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110 [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:07.214745 12111 catalog_manager.cc:1259] Loaded cluster ID: e9f45839b9cf42aab82e387fe092236d
I20260810 14:51:07.214798 12111 catalog_manager.cc:1552] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: loading cluster ID for follower catalog manager: success
W20260810 14:51:07.215119 12111 catalog_manager.cc:1576] T 00000000000000000000000000000000 P eb8db1e1ff8b41f1be5c15ba36849110: acquiring CA information for follower catalog manager: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
W20260810 14:51:07.215175 12111 catalog_manager.cc:873] Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO: failed to prepare follower catalog manager, will retry
I20260810 14:51:07.215212 12101 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:07.215583 12101 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:07.215679 12101 catalog_manager.cc:1259] Loaded cluster ID: e9f45839b9cf42aab82e387fe092236d
I20260810 14:51:07.215715 12101 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260810 14:51:07.215847 12101 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fce90dda9ad google::LogMessage::Fail() at ??:0
@ 0x7fce90ddd88a google::LogMessage::SendToLog() at ??:0
@ 0x7fce90dda4de google::LogMessage::Flush() at ??:0
@ 0x7fce90ddba19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fce98cff0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fce98d088b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fce92ca80d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fce92c9d954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fce93b016db start_thread at ??:0
@ 0x7fce8f8d861f clone at ??:0
W20260810 14:51:07.289533 12078 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:07.289732 12078 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:07.289754 12078 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:07.290959 12078 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:07.291002 12078 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:07.291028 12078 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:51:07.292480 12078 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:41137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=42887
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12078
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:07.292721 12078 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:07.292939 12078 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:51:07.297901 12078 server_base.cc:1034] running on GCE node
W20260810 14:51:07.297927 12138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.297998 12137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.298072 12140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.298353 12078 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:07.298605 12078 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:07.299754 12078 hybrid_clock.cc:648] HybridClock initialized: now 1786373467299741 us; error 33 us; skew 500 ppm
Aug 10 14:51:07 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:07.302480 12078 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:51:07.303051 12078 webserver.cc:460] Webserver started at http://127.19.29.193:42887/ using document root <none> and password file <none>
I20260810 14:51:07.303341 12078 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:07.303412 12078 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:07.305236 12078 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:51:07.306066 12149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.306247 12078 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:07.306376 12078 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "b2925629855d5d695b68ca97e59360ca"
server_key_iv: "a04e99533c5d5c224c62117d25d397cd"
server_key_version: "encryptionkey@0"
I20260810 14:51:07.306833 12078 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:07.334491 12078 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:07.337098 12078 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:07.337275 12078 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:07.337574 12078 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:07.338191 12156 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:51:07.339731 12078 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:51:07.339800 12078 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 14:51:07.339839 12078 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:51:07.340755 12078 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:51:07.340808 12078 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 14:51:07.340867 12156 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap starting.
I20260810 14:51:07.348829 12078 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41137
I20260810 14:51:07.349082 12347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41137 every 8 connection(s)
I20260810 14:51:07.349305 12078 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:51:07.351434 12156 log.cc:824] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:07.351867 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 12078
I20260810 14:51:07.352135 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:38219
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=36747
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:07.354254 12156 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:07.354617 12156 tablet_bootstrap.cc:492] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Bootstrap complete.
I20260810 14:51:07.355834 12156 ts_tablet_manager.cc:1397] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.006s
I20260810 14:51:07.357331 12156 raft_consensus.cc:348] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:07.357700 12156 raft_consensus.cc:729] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 43b4158eaa1c45fc9c5a0d4881f32a6d, State: Initialized, Role: FOLLOWER
I20260810 14:51:07.357856 12156 consensus_queue.cc:260] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:07.358153 12156 ts_tablet_manager.cc:1428] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d: Time spent starting tablet: real 0.002s user 0.002s sys 0.002s
W20260810 14:51:07.422950 12353 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:51:07.350081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:49871)
0810 14:51:07.350329 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.350381 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:07.351009 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:07.422738 (+ 71729us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":109,"threads_started":1}
W20260810 14:51:07.423204 12348 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:44915 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:44915: Client connection negotiation failed: client connection to 127.19.29.254:44915: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:51:07.423580 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.423446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:38009)
0810 14:51:07.423510 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.423556 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:51:07.423920 12353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.423848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:51229)
0810 14:51:07.423880 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.423905 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260810 14:51:07.424039 12348 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:51:07.436517 12358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:07.436691 12358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:07.436717 12358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:07.437764 12358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:07.437795 12358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:07.437819 12358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:51:07.439246 12358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:38219
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=36747
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:07.439415 12358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:07.439585 12358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:07.444217 12370 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.444224 12365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.444228 12366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.444411 12358 server_base.cc:1034] running on GCE node
I20260810 14:51:07.444590 12358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:07.444793 12358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:07.445935 12358 hybrid_clock.cc:648] HybridClock initialized: now 1786373467445922 us; error 29 us; skew 500 ppm
Aug 10 14:51:07 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:07.448310 12358 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:51:07.448750 12358 webserver.cc:460] Webserver started at http://127.19.29.194:36747/ using document root <none> and password file <none>
I20260810 14:51:07.448943 12358 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:07.448990 12358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:07.450178 12358 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:51:07.450757 12380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.450902 12358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.450984 12358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "76730c1247bd4ad99e54a22a9ea8eb3f"
format_stamp: "Formatted at 2026-08-10 14:51:05 on dist-test-slave-4tdj"
server_key: "81b286a57d941e14b81d4f570e40e640"
server_key_iv: "588df643450328b7a535836e22babedd"
server_key_version: "encryptionkey@0"
I20260810 14:51:07.451283 12358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:07.458431 12358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:07.460124 12358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:07.460248 12358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:07.460453 12358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:07.460728 12358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:07.460759 12358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.460785 12358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:07.460810 12358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.466475 12358 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38219
I20260810 14:51:07.466557 12561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38219 every 8 connection(s)
I20260810 14:51:07.466850 12358 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:51:07.467765 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.467421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:58639)
0810 14:51:07.467560 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.467632 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
W20260810 14:51:07.468107 12562 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:44915 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:44915: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
I20260810 14:51:07.468356 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.468262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:57259)
0810 14:51:07.468309 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.468335 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:51:07.468369 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 12358
I20260810 14:51:07.468590 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:36779
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:44915
--webserver_port=40427
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:44543
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:07.470340 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.470190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:58399)
0810 14:51:07.470262 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.470315 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260810 14:51:07.470466 12562 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:51:07.547737 12566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:07.547922 12566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:07.547943 12566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:07.548997 12566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:07.549031 12566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:07.549054 12566 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:51:07.550434 12566 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:44543
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:36779
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=40427
--tserver_master_addrs=127.19.29.254:44915
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:07.550606 12566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:07.550770 12566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:07.555600 12573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.555744 12566 server_base.cc:1034] running on GCE node
W20260810 14:51:07.555676 12577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:07.555689 12574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:07.556074 12566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:07.556291 12566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:07.557425 12566 hybrid_clock.cc:648] HybridClock initialized: now 1786373467557412 us; error 29 us; skew 500 ppm
Aug 10 14:51:07 dist-test-slave-4tdj krb5kdc[10154](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:07.563581 12566 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:51:07.563992 12566 webserver.cc:460] Webserver started at http://127.19.29.195:40427/ using document root <none> and password file <none>
I20260810 14:51:07.564216 12566 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:07.564260 12566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:07.565515 12566 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:51:07.566062 12593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.566215 12566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:51:07.566313 12566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "a5700891b96a466eaf0b2b2f6d97dca2"
format_stamp: "Formatted at 2026-08-10 14:51:06 on dist-test-slave-4tdj"
server_key: "232bfbced0aeaf547f560168a8dd4007"
server_key_iv: "352eff19841f7df42040c4b277add42d"
server_key_version: "encryptionkey@0"
I20260810 14:51:07.566648 12566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:07.591300 12566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:07.593343 12566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:07.593470 12566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:07.593691 12566 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:07.593976 12566 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:07.594010 12566 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.594030 12566 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:07.594043 12566 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:07.599588 12566 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:36779
I20260810 14:51:07.599650 12799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:36779 every 8 connection(s)
I20260810 14:51:07.599944 12566 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:51:07.600946 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.600547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:43369)
0810 14:51:07.600732 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.600808 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
W20260810 14:51:07.601307 12800 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:44915 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:44915: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
I20260810 14:51:07.601560 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.601475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:55329)
0810 14:51:07.601514 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.601543 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260810 14:51:07.601799 12802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:07.601731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:45931)
0810 14:51:07.601765 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:07.601786 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 14:51:07.601886 12800 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:51:07.603899 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 12566
I20260810 14:51:08.424592 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.424352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:57969)
0810 14:51:08.424487 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:08.424526 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260810 14:51:08.470942 12809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.470751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:59619)
0810 14:51:08.470855 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:08.470888 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":60,"threads_started":1}
I20260810 14:51:08.580513 12810 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:08.580663 12810 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:08.581048 12810 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
Aug 10 14:51:08 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.194@KRBTEST.COM
Aug 10 14:51:08 dist-test-slave-4tdj krb5kdc[10154](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373467, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.195@KRBTEST.COM
I20260810 14:51:08.591861 12822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.581357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:39009 (local address 127.19.29.195:36779)
0810 14:51:08.581517 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:08.581524 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:08.581545 (+ 21us) server_negotiation.cc:407] Connection header received
0810 14:51:08.582068 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:08.582084 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:08.582153 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:08.582386 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:08.583004 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.584381 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585373 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.585767 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585866 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:08.588411 (+ 2545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:08.588416 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:08.588416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:08.588428 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:08.590240 (+ 1812us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590643 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:08.590646 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:08.590646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:08.590729 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590959 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:08.590960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:08.590960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:08.591284 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:08.591382 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:08.591638 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 14:51:08.591765 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":44,"threads_started":1}
I20260810 14:51:08.591878 12816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.581331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:35255 (local address 127.19.29.194:38219)
0810 14:51:08.581458 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:08.581471 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:08.581545 (+ 74us) server_negotiation.cc:407] Connection header received
0810 14:51:08.582098 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:08.582101 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:08.582153 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:08.582336 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:08.583249 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.584527 (+ 1278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585364 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.585766 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585865 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:08.588024 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:08.588029 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:08.588029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:08.588041 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:08.590240 (+ 2199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590846 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:08.590849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:08.590849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:08.590938 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:08.591112 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:08.591113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:08.591113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:08.591380 (+ 267us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:08.591456 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:08.591643 (+ 187us) server_negotiation.cc:299] Negotiation successful
0810 14:51:08.591766 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87,"thread_start_us":61,"threads_started":1}
I20260810 14:51:08.591867 12811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.581225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38219 (local address 127.19.29.193:35255)
0810 14:51:08.581487 (+ 262us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:08.581496 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:08.581552 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:08.582989 (+ 1437us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:08.582990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:08.583102 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:08.583147 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:08.583149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.584623 (+ 1474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.584625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:08.585290 (+ 665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:08.585292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.585846 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:08.585955 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:08.586475 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:08.586483 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:08.587919 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:08.590645 (+ 2726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590645 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:08.590645 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:08.590770 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:08.590995 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590995 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:08.590996 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:08.591048 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:08.591447 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:08.591448 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:08.591492 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:51:08.591575 (+ 83us) client_negotiation.cc:240] Negotiation successful
0810 14:51:08.591764 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":1,"thread_start_us":56,"threads_started":1}
I20260810 14:51:08.592214 12805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.581194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:36779 (local address 127.19.29.193:39009)
0810 14:51:08.581252 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:08.581262 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:08.581315 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:08.582361 (+ 1046us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:08.582364 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:08.582705 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:08.582902 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:08.582909 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.584477 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.584478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:08.585292 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:08.585294 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:08.585849 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:08.585850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:08.585955 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:08.586529 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:08.586533 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:08.588309 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:08.590340 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590347 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:08.590348 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:08.590552 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:08.590796 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:08.590797 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:08.590797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:08.590900 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:08.591359 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:08.591367 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:08.591488 (+ 121us) client_negotiation.cc:769] Sending connection context
0810 14:51:08.591573 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:51:08.591839 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":162}
W20260810 14:51:08.592847 12151 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
W20260810 14:51:08.592942 12153 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:08.592995 12153 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d; no voters: 76730c1247bd4ad99e54a22a9ea8eb3f, a5700891b96a466eaf0b2b2f6d97dca2
I20260810 14:51:08.593091 12810 raft_consensus.cc:2726] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:51:08.602349 12823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:08.602148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:49937)
0810 14:51:08.602247 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:08.602307 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":49,"threads_started":1}
I20260810 14:51:09.425187 12824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:09.424958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:33665)
0810 14:51:09.425098 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:09.425139 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260810 14:51:09.471639 12825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:09.471409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:41435)
0810 14:51:09.471545 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:09.471589 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":61,"threads_started":1}
I20260810 14:51:09.602906 12830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:09.602718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:48411)
0810 14:51:09.602832 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:09.602868 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":61,"threads_started":1}
I20260810 14:51:10.425815 12831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:10.425576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:41349)
0810 14:51:10.425725 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:10.425766 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260810 14:51:10.427175 12833 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:10.427253 12833 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:10.427382 12833 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
W20260810 14:51:10.427798 12151 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
W20260810 14:51:10.427874 12153 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:10.427951 12153 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d; no voters: 76730c1247bd4ad99e54a22a9ea8eb3f, a5700891b96a466eaf0b2b2f6d97dca2
I20260810 14:51:10.428042 12833 raft_consensus.cc:2726] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:51:10.472241 12834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:10.472022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:40607)
0810 14:51:10.472170 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:10.472201 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":93,"threads_started":1}
I20260810 14:51:10.603473 12837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:10.603280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:45289)
0810 14:51:10.603403 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:10.603437 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260810 14:51:11.426528 12840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:11.426319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:42929)
0810 14:51:11.426435 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:11.426474 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260810 14:51:11.472870 12841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:11.472682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:60913)
0810 14:51:11.472794 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:11.472829 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260810 14:51:11.604079 12842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:11.603851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:51419)
0810 14:51:11.603991 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:11.604042 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260810 14:51:12.427147 12843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:12.426931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:38563)
0810 14:51:12.427066 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:12.427100 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":79,"threads_started":1}
I20260810 14:51:12.473475 12844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:12.473255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:39343)
0810 14:51:12.473398 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:12.473434 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":79,"threads_started":1}
I20260810 14:51:12.556564 12845 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:12.556663 12845 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:12.556833 12845 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
W20260810 14:51:12.557191 12151 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
W20260810 14:51:12.557274 12153 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:12.557334 12153 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d; no voters: 76730c1247bd4ad99e54a22a9ea8eb3f, a5700891b96a466eaf0b2b2f6d97dca2
I20260810 14:51:12.557415 12845 raft_consensus.cc:2726] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:51:12.604678 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:12.604463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:53409)
0810 14:51:12.604581 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:12.604626 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260810 14:51:13.427796 12850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:13.427553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:39093)
0810 14:51:13.427713 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:13.427751 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":89,"threads_started":1}
I20260810 14:51:13.474102 12851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:13.473898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:49471)
0810 14:51:13.474026 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:13.474061 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260810 14:51:13.605293 12853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:13.605084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:49097)
0810 14:51:13.605216 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:13.605255 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":57,"threads_started":1}
I20260810 14:51:14.428447 12854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:14.428227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:58437)
0810 14:51:14.428351 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:14.428389 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":62,"threads_started":1}
I20260810 14:51:14.474740 12855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:14.474521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:58841)
0810 14:51:14.474662 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:14.474695 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":83,"threads_started":1}
I20260810 14:51:14.605989 12856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:14.605735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:60635)
0810 14:51:14.605905 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:14.605947 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260810 14:51:15.429096 12858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:15.428848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:37549)
0810 14:51:15.429007 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:15.429048 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":81,"threads_started":1}
I20260810 14:51:15.475334 12859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:15.475130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:60085)
0810 14:51:15.475257 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:15.475292 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260810 14:51:15.606681 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:15.606473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:56149)
0810 14:51:15.606607 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:15.606642 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":78,"threads_started":1}
I20260810 14:51:16.019330 12869 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:16.019449 12869 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:16.019630 12869 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
W20260810 14:51:16.019960 12153 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
W20260810 14:51:16.020045 12151 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:16.020177 12151 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d; no voters: 76730c1247bd4ad99e54a22a9ea8eb3f, a5700891b96a466eaf0b2b2f6d97dca2
I20260810 14:51:16.020260 12869 raft_consensus.cc:2726] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:51:16.429797 12870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:16.429556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:39323)
0810 14:51:16.429710 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:16.429748 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":75,"threads_started":1}
I20260810 14:51:16.475978 12872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:16.475743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:48175)
0810 14:51:16.475866 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:16.475907 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":58,"threads_started":1}
I20260810 14:51:16.607331 12873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:16.607114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:35129)
0810 14:51:16.607247 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:16.607285 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260810 14:51:17.430542 12874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:17.430279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:51665)
0810 14:51:17.430441 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:17.430488 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260810 14:51:17.476657 12875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:17.476416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:36927)
0810 14:51:17.476576 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:17.476609 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":108,"threads_started":1}
I20260810 14:51:17.607977 12876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:17.607764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:44029)
0810 14:51:17.607902 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:17.607939 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":83,"threads_started":1}
I20260810 14:51:18.431268 12877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:18.431004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:45267)
0810 14:51:18.431184 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:18.431221 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":99,"threads_started":1}
I20260810 14:51:18.477325 12878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:18.477111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:46153)
0810 14:51:18.477246 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:18.477281 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260810 14:51:18.608654 12880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:18.608432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:45833)
0810 14:51:18.608576 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:18.608612 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260810 14:51:19.431972 12883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:19.431714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:43867)
0810 14:51:19.431880 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:19.431921 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":85,"threads_started":1}
I20260810 14:51:19.477978 12884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:19.477753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:57825)
0810 14:51:19.477895 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:19.477932 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260810 14:51:19.609362 12885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:19.609112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:49927)
0810 14:51:19.609275 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:19.609317 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":79,"threads_started":1}
I20260810 14:51:20.151783 12886 raft_consensus.cc:482] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:20.151913 12886 raft_consensus.cc:504] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a5700891b96a466eaf0b2b2f6d97dca2" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 36779 } } peers { permanent_uuid: "76730c1247bd4ad99e54a22a9ea8eb3f" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38219 } } peers { permanent_uuid: "43b4158eaa1c45fc9c5a0d4881f32a6d" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41137 } }
I20260810 14:51:20.152099 12886 leader_election.cc:288] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779), 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219)
W20260810 14:51:20.152491 12151 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 76730c1247bd4ad99e54a22a9ea8eb3f (127.19.29.194:38219): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
W20260810 14:51:20.152585 12153 leader_election.cc:341] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer a5700891b96a466eaf0b2b2f6d97dca2 (127.19.29.195:36779): Not found: Tablet not found: 35f148f83f1442d09e18b32d94d47ae1
I20260810 14:51:20.152635 12153 leader_election.cc:302] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 43b4158eaa1c45fc9c5a0d4881f32a6d; no voters: 76730c1247bd4ad99e54a22a9ea8eb3f, a5700891b96a466eaf0b2b2f6d97dca2
I20260810 14:51:20.152698 12886 raft_consensus.cc:2726] T 35f148f83f1442d09e18b32d94d47ae1 P 43b4158eaa1c45fc9c5a0d4881f32a6d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:51:20.432654 12887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:20.432387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:40009)
0810 14:51:20.432557 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:20.432599 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":86,"threads_started":1}
I20260810 14:51:20.478667 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:20.478439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:46297)
0810 14:51:20.478587 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:20.478619 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":104,"threads_started":1}
I20260810 14:51:20.610057 12891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:20.609834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:40701)
0810 14:51:20.609976 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:20.610015 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":78,"threads_started":1}
I20260810 14:51:21.433320 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:21.433095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:60735)
0810 14:51:21.433235 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:21.433273 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":68,"threads_started":1}
I20260810 14:51:21.479264 12895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:21.479041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:39965)
0810 14:51:21.479188 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:21.479222 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260810 14:51:21.610790 12896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:21.610514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:37287)
0810 14:51:21.610670 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:21.610716 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260810 14:51:22.434110 12898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:22.433867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.193:51125)
0810 14:51:22.434016 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:22.434057 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":62,"threads_started":1}
I20260810 14:51:22.479918 12899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:22.479735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.194:32991)
0810 14:51:22.479845 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:22.479874 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":64,"threads_started":1}
I20260810 14:51:22.611301 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 12078
I20260810 14:51:22.616134 12902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:22.611323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:44915 (local address 127.19.29.195:43365)
0810 14:51:22.616009 (+ 4686us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:22.616076 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:44915: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4660,"thread_start_us":63,"threads_started":1}
I20260810 14:51:22.629539 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 12358
I20260810 14:51:22.642779 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 12566
2026-08-10T14:51:22Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18394 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:51:22 dist-test-slave-4tdj krb5kdc[12905](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:51:22 dist-test-slave-4tdj krb5kdc[12905](info): set up 2 sockets
Aug 10 14:51:22 dist-test-slave-4tdj krb5kdc[12905](info): commencing operation
krb5kdc: starting...
W20260810 14:51:23.810272 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:51:23 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:51:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:51:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:51:23.922451 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:24.001770 12927 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:24.001960 12927 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:24.001981 12927 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:24.003099 12927 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:51:24.003132 12927 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:51:24.003144 12927 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:51:24.003153 12927 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:24.003165 12927 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:24.003176 12927 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:24.003187 12927 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:24.003197 12927 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:24.004616 12927 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12927
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:24.004806 12927 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:24.004969 12927 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:51:24.010041 12927 server_base.cc:1034] running on GCE node
W20260810 14:51:24.010082 12941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.010053 12938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.010047 12936 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:24.010715 12927 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:24.010990 12927 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:24.012128 12927 hybrid_clock.cc:648] HybridClock initialized: now 1786373484012116 us; error 30 us; skew 500 ppm
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:24.014537 12927 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:24.014958 12927 webserver.cc:460] Webserver started at http://127.19.29.254:37319/ using document root <none> and password file <none>
I20260810 14:51:24.015187 12927 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:24.015236 12927 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:24.015360 12927 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:24.016402 12927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "d86905a5c2fe4968837a7e9b826459ec"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "e39da9b7a1d1458fad259a6502282834"
server_key_iv: "8e4dbfb7236b1a6883e0f9c6083ad10c"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.016733 12927 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "d86905a5c2fe4968837a7e9b826459ec"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "e39da9b7a1d1458fad259a6502282834"
server_key_iv: "8e4dbfb7236b1a6883e0f9c6083ad10c"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.017931 12927 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:51:24.018673 12950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.018827 12927 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.018913 12927 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "d86905a5c2fe4968837a7e9b826459ec"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "e39da9b7a1d1458fad259a6502282834"
server_key_iv: "8e4dbfb7236b1a6883e0f9c6083ad10c"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.018970 12927 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:24.028860 12927 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:24.030494 12927 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:24.030619 12927 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:24.034358 12927 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36257
I20260810 14:51:24.034405 13037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36257 every 8 connection(s)
I20260810 14:51:24.034706 12927 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:24.035537 13038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:24.036528 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 12927
I20260810 14:51:24.036630 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:51:24.036816 19575 external_mini_cluster.cc:1428] Setting key c9b7839d8bfb6fa5870fb04f2802021e
I20260810 14:51:24.038336 13038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap starting.
I20260810 14:51:24.039005 13038 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:24.039332 13038 log.cc:824] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:24.040087 13038 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: No bootstrap required, opened a new log
I20260810 14:51:24.042254 13038 raft_consensus.cc:348] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:24.042436 13038 raft_consensus.cc:374] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:24.042470 13038 raft_consensus.cc:729] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Initialized, Role: FOLLOWER
I20260810 14:51:24.042601 13038 consensus_queue.cc:260] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:24.042676 13038 raft_consensus.cc:388] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:24.042703 13038 raft_consensus.cc:482] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:24.042754 13038 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:24.043417 13038 raft_consensus.cc:504] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:24.043540 13038 leader_election.cc:302] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d86905a5c2fe4968837a7e9b826459ec; no voters:
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373483, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:24.043704 13038 leader_election.cc:288] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:51:24.043748 13047 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:24.043920 13047 raft_consensus.cc:686] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 LEADER]: Becoming Leader. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Running, Role: LEADER
I20260810 14:51:24.044042 13038 sys_catalog.cc:564] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:24.044090 13047 consensus_queue.cc:237] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:24.044780 13048 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:51:24.044878 13048 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:24.045079 13063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:24.045068 13049 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader d86905a5c2fe4968837a7e9b826459ec. Latest consensus state: current_term: 1 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:51:24.045230 13049 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:24.045660 13063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:24.047290 13063 catalog_manager.cc:1347] Generated new cluster ID: 9eabb63f76ed484b80d642934998dacc
I20260810 14:51:24.047338 13063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:51:24.048161 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.037283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37816 (local address 127.19.29.254:36257)
0810 14:51:24.037452 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.037471 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.037508 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:51:24.038021 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.038030 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.038095 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.038252 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:24.038818 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.040058 (+ 1240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.040783 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.041412 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.041557 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.044175 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:24.044179 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:24.044179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:24.044191 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:24.046520 (+ 2329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.046988 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.046991 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.046991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.047081 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.047310 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.047311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.047311 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.047586 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:24.047743 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.047871 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.048007 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":74,"threads_started":1}
I20260810 14:51:24.059643 13063 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:51:24.060094 13063 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:51:24.065071 13063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Generated new TSK 0
I20260810 14:51:24.065243 13063 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:51:24.102174 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:24.182816 13082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:24.183009 13082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:24.183032 13082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:24.184111 13082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:24.184144 13082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:24.184167 13082 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:51:24.185586 13082 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:24.185775 13082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:24.185947 13082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:24.190765 13091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.190775 13089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.190775 13088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:24.190860 13082 server_base.cc:1034] running on GCE node
I20260810 14:51:24.191195 13082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:24.191412 13082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:24.192549 13082 hybrid_clock.cc:648] HybridClock initialized: now 1786373484192533 us; error 33 us; skew 500 ppm
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:24.195016 13082 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:51:24.195429 13082 webserver.cc:460] Webserver started at http://127.19.29.193:45179/ using document root <none> and password file <none>
I20260810 14:51:24.195669 13082 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:24.195714 13082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:24.195837 13082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:24.196849 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "202df617d2fa258d8fac2e90bf80d961"
server_key_iv: "dde262a50abb99c69f239a69ba76a562"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.197175 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "202df617d2fa258d8fac2e90bf80d961"
server_key_iv: "dde262a50abb99c69f239a69ba76a562"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.198419 13082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:51:24.199131 13101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.199288 13082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:24.199373 13082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "202df617d2fa258d8fac2e90bf80d961"
server_key_iv: "dde262a50abb99c69f239a69ba76a562"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.199435 13082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:24.206784 13082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:24.208417 13082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:24.208544 13082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:24.208741 13082 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:24.209017 13082 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:24.209049 13082 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.209075 13082 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:24.209092 13082 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.214645 13082 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:45401
I20260810 14:51:24.214689 13286 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:45401 every 8 connection(s)
I20260810 14:51:24.214975 13082 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:51:24.216919 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 13082
I20260810 14:51:24.217012 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:51:24.217173 19575 external_mini_cluster.cc:1428] Setting key 0a07dc3df8d00fa7a58604ba95aaf34b
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:24.224280 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.215635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:51901 (local address 127.19.29.254:36257)
0810 14:51:24.215711 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.215713 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.215873 (+ 160us) server_negotiation.cc:407] Connection header received
0810 14:51:24.216339 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.216340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.216351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.216398 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:24.217381 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.218044 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.219374 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.219676 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.219744 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.221712 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:24.221713 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:24.221714 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:24.221721 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:24.222996 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.223411 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.223413 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.223413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.223467 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.223684 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.223685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.223685 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.223794 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:24.223849 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.224101 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.224191 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:51:24.224472 13294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.215607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:51901)
0810 14:51:24.215766 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.215800 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.216254 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.216454 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.216457 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.217053 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:24.217291 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.217297 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.218147 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.218148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.219286 (+ 1138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.219289 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.219770 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.219771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.219873 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.220323 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:24.220331 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:24.221623 (+ 1292us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:24.223091 (+ 1468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.223099 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.223101 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.223346 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.223522 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.223523 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.223523 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.223628 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.223849 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:24.223857 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:24.223986 (+ 129us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.224070 (+ 84us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.224229 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
I20260810 14:51:24.224972 13287 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:24.225073 13287 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:24.225276 13287 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:24.225847 12975 ts_manager.cc:194] Registered new tserver with Master: eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
I20260810 14:51:24.226601 12975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:51901
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:51:24.242237 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:24.322365 13297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:24.322582 13297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:24.322615 13297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:24.323791 13297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:24.323832 13297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:24.323866 13297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:51:24.325323 13297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:24.325559 13297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:24.325765 13297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:24.330657 13316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:24.330768 13297 server_base.cc:1034] running on GCE node
W20260810 14:51:24.330647 13312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.330647 13320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:24.331049 13297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:24.331290 13297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:24.332485 13297 hybrid_clock.cc:648] HybridClock initialized: now 1786373484332443 us; error 26 us; skew 500 ppm
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:24.334988 13297 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:51:24.335407 13297 webserver.cc:460] Webserver started at http://127.19.29.194:44609/ using document root <none> and password file <none>
I20260810 14:51:24.335604 13297 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:24.335652 13297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:24.335774 13297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:24.336827 13297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "60d0233f4d844b158a2e035b8b7265ba"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "99b3fc2fcfb85f9d01f5eec3170d8de5"
server_key_iv: "259ca3841915cd6f73e832f07be0a300"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.337147 13297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "60d0233f4d844b158a2e035b8b7265ba"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "99b3fc2fcfb85f9d01f5eec3170d8de5"
server_key_iv: "259ca3841915cd6f73e832f07be0a300"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.338779 13297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:51:24.339620 13333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.339782 13297 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:24.339880 13297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "60d0233f4d844b158a2e035b8b7265ba"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "99b3fc2fcfb85f9d01f5eec3170d8de5"
server_key_iv: "259ca3841915cd6f73e832f07be0a300"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.339954 13297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:24.357954 13297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:24.360049 13297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:24.360204 13297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:24.360463 13297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:24.360782 13297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:24.360819 13297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.360853 13297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:24.360878 13297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.367033 13297 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38325
I20260810 14:51:24.367096 13527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38325 every 8 connection(s)
I20260810 14:51:24.367408 13297 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:24.376353 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.368188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:57999 (local address 127.19.29.254:36257)
0810 14:51:24.368253 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.368255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.368488 (+ 233us) server_negotiation.cc:407] Connection header received
0810 14:51:24.368958 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.368959 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.368972 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.369033 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:24.369977 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.370573 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.371620 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.371813 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.371876 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.373845 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:24.373847 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:24.373847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:24.373853 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:24.375095 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.375466 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.375467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.375467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.375528 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.375745 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.375746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.375746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.375860 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:24.375915 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.376183 (+ 268us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.376263 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:51:24.376516 13532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.368148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:57999)
0810 14:51:24.368330 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.368374 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.368867 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.369090 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.369093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.369677 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:24.369879 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.369884 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.370677 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.370678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.371519 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.371522 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.371885 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.371885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.371998 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.372421 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:24.372429 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:24.373751 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:24.375171 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.375179 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.375182 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.375400 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.375583 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.375584 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.375584 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.375690 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.375916 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:24.375923 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:24.376062 (+ 139us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.376149 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.376305 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":91,"threads_started":1}
I20260810 14:51:24.376931 13529 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:24.377039 13529 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:24.377102 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 13297
I20260810 14:51:24.377205 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:51:24.377238 13529 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:24.377404 19575 external_mini_cluster.cc:1428] Setting key b399d605e59275b72bdfc4e93d27a7cf
I20260810 14:51:24.377658 12975 ts_manager.cc:194] Registered new tserver with Master: 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
I20260810 14:51:24.378248 12975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:57999
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:51:24.402145 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:24.484267 13538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:24.484449 13538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:24.484480 13538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:24.485592 13538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:24.485633 13538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:24.485667 13538 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:51:24.487093 13538 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:24.487318 13538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:24.487511 13538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:24.492255 13547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.492293 13546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:24.492259 13551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:24.492493 13538 server_base.cc:1034] running on GCE node
I20260810 14:51:24.492707 13538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:24.492903 13538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:24.494041 13538 hybrid_clock.cc:648] HybridClock initialized: now 1786373484494027 us; error 27 us; skew 500 ppm
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:24.496459 13538 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:51:24.496883 13538 webserver.cc:460] Webserver started at http://127.19.29.195:33925/ using document root <none> and password file <none>
I20260810 14:51:24.497104 13538 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:24.497151 13538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:24.497275 13538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:51:24.498277 13538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "babe3da7e2004750bd409300dd67773b"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "0b96b3a11f7ff370694235deadabd3eb"
server_key_iv: "1dd463f4e39a99b37bfb0aa3f40dae23"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.498663 13538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "babe3da7e2004750bd409300dd67773b"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "0b96b3a11f7ff370694235deadabd3eb"
server_key_iv: "1dd463f4e39a99b37bfb0aa3f40dae23"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.499836 13538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:51:24.500516 13564 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.500694 13538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:51:24.500777 13538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "babe3da7e2004750bd409300dd67773b"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "0b96b3a11f7ff370694235deadabd3eb"
server_key_iv: "1dd463f4e39a99b37bfb0aa3f40dae23"
server_key_version: "encryptionkey@0"
I20260810 14:51:24.500844 13538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:24.524305 13538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:24.525909 13538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:24.526037 13538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:24.526228 13538 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:24.526552 13538 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:24.526618 13538 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.526644 13538 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:24.526667 13538 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:24.532074 13538 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45243
I20260810 14:51:24.532135 13758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45243 every 8 connection(s)
I20260810 14:51:24.532397 13538 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:51:24 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373484, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:24.539106 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 13538
I20260810 14:51:24.539198 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:51:24.539377 19575 external_mini_cluster.cc:1428] Setting key 21bc998b3555d95a43681ff48781f9c1
I20260810 14:51:24.540769 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.533038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:49141 (local address 127.19.29.254:36257)
0810 14:51:24.533077 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.533079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.533268 (+ 189us) server_negotiation.cc:407] Connection header received
0810 14:51:24.533713 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.533714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.533724 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.533777 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:24.534673 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.535170 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.536066 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.536256 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.536306 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.538090 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:24.538091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:24.538092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:24.538098 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:24.539391 (+ 1293us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.539801 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.539802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.539803 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.539859 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.540122 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.540123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.540124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.540259 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:24.540321 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.540609 (+ 288us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.540684 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:51:24.540925 13761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.533000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:49141)
0810 14:51:24.533151 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.533191 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.533639 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.533828 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.533831 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.534411 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:24.534600 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.534605 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.535234 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.535235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.536000 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.536002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.536313 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.536314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.536402 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.536776 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:24.536784 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:24.538008 (+ 1224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:24.539495 (+ 1487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.539502 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.539504 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.539732 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.539917 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:24.539918 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:24.539919 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:24.540076 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:24.540326 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:24.540333 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:24.540460 (+ 127us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.540578 (+ 118us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.540729 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260810 14:51:24.541329 13759 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:24.541414 13759 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:24.541558 13759 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:24.541869 12975 ts_manager.cc:194] Registered new tserver with Master: babe3da7e2004750bd409300dd67773b (127.19.29.195:45243)
I20260810 14:51:24.542193 12975 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:49141
I20260810 14:51:24.551002 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:51:24.557231 13042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.552239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37832 (local address 127.19.29.254:36257)
0810 14:51:24.552278 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.552280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.552388 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:51:24.552438 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.552439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.552447 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.552485 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:24.552942 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.553393 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.554040 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.554214 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.554256 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.555305 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:24.555306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:24.555306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:24.555311 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:24.556336 (+ 1025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.556649 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.556650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.556651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.556704 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:24.556845 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:24.556845 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:24.556845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:24.556964 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:24.557046 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.557112 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.557174 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:51:24.558625 12975 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37832:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:51:24.560148 12975 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:51:24.566141 13772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38325 (local address 127.0.0.1:51930)
0810 14:51:24.562318 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.562356 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.562422 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.562736 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.562739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.562741 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:24.562799 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.562800 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.564067 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.564068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.565145 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.565147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.565851 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.565931 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.565944 (+ 13us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.566008 (+ 64us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.566056 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":23,"thread_start_us":67,"threads_started":1}
I20260810 14:51:24.566224 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36422 (local address 127.19.29.193:45401)
0810 14:51:24.562755 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.562759 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.562768 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:51:24.562804 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.562806 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.562819 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.562917 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:24.563035 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.563763 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565196 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.565880 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565978 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.566039 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.566117 (+ 78us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.566150 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":337,"thread_start_us":87,"threads_started":1}
I20260810 14:51:24.566566 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41220 (local address 127.19.29.195:45243)
0810 14:51:24.562699 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.562704 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.562713 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:51:24.562748 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.562750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.562766 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.562849 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:24.563138 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.564144 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565148 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.565874 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565978 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.566039 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.566445 (+ 406us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.566490 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":72,"threads_started":1}
I20260810 14:51:24.566627 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51930 (local address 127.19.29.194:38325)
0810 14:51:24.562581 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.562585 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.562601 (+ 16us) server_negotiation.cc:407] Connection header received
0810 14:51:24.562633 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.562634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.562646 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.562713 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:24.562876 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.563955 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565240 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.565774 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565840 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.565898 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.566506 (+ 608us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.566552 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":96,"threads_started":1}
I20260810 14:51:24.566262 13775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.0.0.1:36422)
0810 14:51:24.562382 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.562392 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.562450 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.562921 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.562922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.562924 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:24.562979 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.562980 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.563857 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.563858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.565116 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.565118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.565991 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.565992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.566046 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.566049 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.566105 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.566138 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":216,"mutex_wait_us":5,"thread_start_us":47,"threads_started":1}
I20260810 14:51:24.566381 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.562174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45243 (local address 127.0.0.1:41220)
0810 14:51:24.562530 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.562539 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.562576 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.562860 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.562860 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.562862 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:24.562894 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.562895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.564231 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.564232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.565065 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.565067 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.566171 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.566171 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.566222 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.566226 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.566273 (+ 47us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.566328 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":18,"thread_start_us":55,"threads_started":1}
I20260810 14:51:24.567374 13650 tablet_service.cc:1467] Processing CreateTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 (DEFAULT_TABLE table=test-table [id=c131972549014e11af35e687431aaf62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:24.567392 13415 tablet_service.cc:1467] Processing CreateTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 (DEFAULT_TABLE table=test-table [id=c131972549014e11af35e687431aaf62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:24.567682 13650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b872a75d8ad64937a7ea98a0ce6a9d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:24.567719 13415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b872a75d8ad64937a7ea98a0ce6a9d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:24.570029 13781 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Bootstrap starting.
I20260810 14:51:24.570317 13784 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Bootstrap starting.
I20260810 14:51:24.570421 13184 tablet_service.cc:1467] Processing CreateTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 (DEFAULT_TABLE table=test-table [id=c131972549014e11af35e687431aaf62]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:24.570734 13184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b872a75d8ad64937a7ea98a0ce6a9d56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:24.570783 13781 tablet_bootstrap.cc:654] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:24.570919 13784 tablet_bootstrap.cc:654] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:24.571286 13781 log.cc:824] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:24.571368 13784 log.cc:824] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:24.572033 13781 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: No bootstrap required, opened a new log
I20260810 14:51:24.572106 13781 ts_tablet_manager.cc:1397] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:24.572160 13784 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: No bootstrap required, opened a new log
I20260810 14:51:24.572209 13784 ts_tablet_manager.cc:1397] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:51:24.573850 13790 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap starting.
I20260810 14:51:24.573962 13784 raft_consensus.cc:348] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.573962 13781 raft_consensus.cc:348] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.574144 13784 raft_consensus.cc:374] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:24.574144 13781 raft_consensus.cc:374] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:24.574182 13781 raft_consensus.cc:729] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: babe3da7e2004750bd409300dd67773b, State: Initialized, Role: FOLLOWER
I20260810 14:51:24.574182 13784 raft_consensus.cc:729] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d0233f4d844b158a2e035b8b7265ba, State: Initialized, Role: FOLLOWER
I20260810 14:51:24.574321 13784 consensus_queue.cc:260] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.574313 13781 consensus_queue.cc:260] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.574457 13790 tablet_bootstrap.cc:654] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:24.574599 13784 ts_tablet_manager.cc:1428] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:51:24.574592 13781 ts_tablet_manager.cc:1428] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:24.574644 13759 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
I20260810 14:51:24.574717 13529 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
I20260810 14:51:24.574999 13790 log.cc:824] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:24.575770 13790 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: No bootstrap required, opened a new log
I20260810 14:51:24.575872 13790 ts_tablet_manager.cc:1397] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:24.577159 13790 raft_consensus.cc:348] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.577286 13790 raft_consensus.cc:374] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:24.577306 13790 raft_consensus.cc:729] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac71b34b8974c09ae9346dcce1e1ac3, State: Initialized, Role: FOLLOWER
I20260810 14:51:24.577391 13790 consensus_queue.cc:260] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.577627 13790 ts_tablet_manager.cc:1428] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:51:24.577661 13287 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
W20260810 14:51:24.618062 13531 tablet.cc:2369] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:51:24.715704 13291 tablet.cc:2369] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:51:24.773535 13795 raft_consensus.cc:482] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:24.773676 13795 raft_consensus.cc:504] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.774084 13795 leader_election.cc:288] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325), eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
I20260810 14:51:24.776944 13776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.774382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:57741 (local address 127.19.29.194:38325)
0810 14:51:24.774425 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.774427 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.774437 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:51:24.774470 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.774471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.774480 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.774528 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:24.774727 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.775274 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776199 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.776617 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776672 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.776681 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.776841 (+ 160us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.776878 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:51:24.776950 13777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.774352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:34423 (local address 127.19.29.193:45401)
0810 14:51:24.774396 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.774398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.774663 (+ 265us) server_negotiation.cc:407] Connection header received
0810 14:51:24.774702 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.774703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.774714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.774761 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:24.774896 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.775370 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776293 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.776656 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776727 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.776735 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.776854 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.776888 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:51:24.776949 13761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.774270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38325 (local address 127.19.29.195:57741)
0810 14:51:24.774354 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.774367 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.774416 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.774546 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.774547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.774549 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:24.774636 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.774639 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.775352 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.775353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.776108 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.776111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.776695 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776697 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.776778 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.776781 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.776824 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.776865 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260810 14:51:24.776962 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.774283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.19.29.195:34423)
0810 14:51:24.774579 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.774589 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:24.774647 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:24.774771 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:24.774772 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:24.774773 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:24.774838 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.774840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.775445 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.775446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.776205 (+ 759us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:24.776208 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.776732 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.776732 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:24.776786 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.776790 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:51:24.776838 (+ 48us) client_negotiation.cc:240] Negotiation successful
0810 14:51:24.776875 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":279,"mutex_wait_us":11,"thread_start_us":139,"threads_started":1}
I20260810 14:51:24.777354 13216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b872a75d8ad64937a7ea98a0ce6a9d56" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" is_pre_election: true
I20260810 14:51:24.777377 13448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b872a75d8ad64937a7ea98a0ce6a9d56" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d0233f4d844b158a2e035b8b7265ba" is_pre_election: true
I20260810 14:51:24.777515 13448 raft_consensus.cc:2454] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 0.
I20260810 14:51:24.777515 13216 raft_consensus.cc:2454] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 0.
I20260810 14:51:24.777776 13566 leader_election.cc:302] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: babe3da7e2004750bd409300dd67773b, eac71b34b8974c09ae9346dcce1e1ac3; no voters:
I20260810 14:51:24.777915 13795 raft_consensus.cc:2781] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:51:24.777992 13795 raft_consensus.cc:482] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:51:24.778010 13795 raft_consensus.cc:3037] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:24.778764 13795 raft_consensus.cc:504] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.778885 13795 leader_election.cc:288] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 election: Requested vote from peers 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325), eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
I20260810 14:51:24.779042 13216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b872a75d8ad64937a7ea98a0ce6a9d56" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
I20260810 14:51:24.779122 13448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b872a75d8ad64937a7ea98a0ce6a9d56" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d0233f4d844b158a2e035b8b7265ba"
I20260810 14:51:24.779134 13216 raft_consensus.cc:3037] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:24.779199 13448 raft_consensus.cc:3037] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:24.780040 13216 raft_consensus.cc:2454] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 1.
I20260810 14:51:24.780040 13448 raft_consensus.cc:2454] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 1.
I20260810 14:51:24.780203 13566 leader_election.cc:302] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: babe3da7e2004750bd409300dd67773b, eac71b34b8974c09ae9346dcce1e1ac3; no voters:
I20260810 14:51:24.780278 13795 raft_consensus.cc:2781] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:24.780414 13795 raft_consensus.cc:686] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 1 LEADER]: Becoming Leader. State: Replica: babe3da7e2004750bd409300dd67773b, State: Running, Role: LEADER
I20260810 14:51:24.780494 13795 consensus_queue.cc:237] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:24.781411 12975 catalog_manager.cc:5495] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b reported cstate change: term changed from 0 to 1, leader changed from <none> to babe3da7e2004750bd409300dd67773b (127.19.29.195). New cstate: current_term: 1 leader_uuid: "babe3da7e2004750bd409300dd67773b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } health_report { overall_health: HEALTHY } } }
W20260810 14:51:24.782866 13760 tablet.cc:2369] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:51:24.790684 13780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.788637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41232 (local address 127.19.29.195:45243)
0810 14:51:24.788685 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:24.788686 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:24.788693 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:51:24.788721 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:24.788722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:24.788738 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:24.788793 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:24.788872 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.789305 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.790030 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:24.790217 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:24.790272 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:24.790436 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:24.790528 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:51:24.790605 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:24.790618 (+ 13us) server_negotiation.cc:299] Negotiation successful
0810 14:51:24.790634 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:51:24.792246 13448 raft_consensus.cc:1261] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Refusing update from remote peer babe3da7e2004750bd409300dd67773b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:24.792258 13216 raft_consensus.cc:1261] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Refusing update from remote peer babe3da7e2004750bd409300dd67773b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:24.792564 13795 consensus_queue.cc:1035] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:24.792701 13799 consensus_queue.cc:1035] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:24.795403 13805 mvcc.cc:205] Tried to move back new op lower bound from 7316985793706725376 to 7316985793661763584. Current Snapshot: MvccSnapshot[applied={T|T < 7316985793706725376}]
I20260810 14:51:24.795855 13808 mvcc.cc:205] Tried to move back new op lower bound from 7316985793706725376 to 7316985793661763584. Current Snapshot: MvccSnapshot[applied={T|T < 7316985793706725376}]
I20260810 14:51:24.797420 12973 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:24.797510 12973 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37832:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:24.798223 12973 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Sending DeleteTablet for 3 replicas of tablet b872a75d8ad64937a7ea98a0ce6a9d56
I20260810 14:51:24.798565 13650 tablet_service.cc:1514] Processing DeleteTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:24 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:41220
I20260810 14:51:24.798588 13415 tablet_service.cc:1514] Processing DeleteTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:24 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:51930
I20260810 14:51:24.798657 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 13082
I20260810 14:51:24.798801 13819 tablet_replica.cc:330] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: stopping tablet replica
I20260810 14:51:24.798883 13819 raft_consensus.cc:2229] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:51:24.798983 13819 raft_consensus.cc:2258] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:24.805454 13819 ts_tablet_manager.cc:1905] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:24.806885 13822 tablet_replica.cc:330] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: stopping tablet replica
I20260810 14:51:24.807081 13819 ts_tablet_manager.cc:1918] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:24.807189 13819 log.cc:1196] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/b872a75d8ad64937a7ea98a0ce6a9d56
I20260810 14:51:24.807564 13819 ts_tablet_manager.cc:1939] T b872a75d8ad64937a7ea98a0ce6a9d56 P babe3da7e2004750bd409300dd67773b: Deleting consensus metadata
I20260810 14:51:24.808106 12953 catalog_manager.cc:4841] TS babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): tablet b872a75d8ad64937a7ea98a0ce6a9d56 (table test-table [id=c131972549014e11af35e687431aaf62]) successfully deleted
I20260810 14:51:24.808329 13822 raft_consensus.cc:2229] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:24.808468 13822 raft_consensus.cc:2258] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:24.811726 13822 ts_tablet_manager.cc:1905] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:24.813083 13822 ts_tablet_manager.cc:1918] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:24.813153 13822 log.cc:1196] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/b872a75d8ad64937a7ea98a0ce6a9d56
I20260810 14:51:24.813386 13822 ts_tablet_manager.cc:1939] T b872a75d8ad64937a7ea98a0ce6a9d56 P 60d0233f4d844b158a2e035b8b7265ba: Deleting consensus metadata
I20260810 14:51:24.813802 12955 catalog_manager.cc:4841] TS 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): tablet b872a75d8ad64937a7ea98a0ce6a9d56 (table test-table [id=c131972549014e11af35e687431aaf62]) successfully deleted
W20260810 14:51:24.819244 12952 connection.cc:535] client connection to 127.19.29.193:45401 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 14:51:24.819351 12952 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:51:24.819442 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 13297
I20260810 14:51:24.823415 13773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:24.823262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.0.0.1:36426)
0810 14:51:24.823324 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:24.823376 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260810 14:51:24.824123 12952 catalog_manager.cc:4584] TS eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b872a75d8ad64937a7ea98a0ce6a9d56: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45401: connect: Connection refused (error 111)
I20260810 14:51:24.836903 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 13538
I20260810 14:51:24.852512 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 12927
I20260810 14:51:44.860860 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--webserver_interface=127.19.29.254
--webserver_port=37319
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:51:44.944515 13828 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:44.944717 13828 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:44.944746 13828 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:44.945873 13828 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:51:44.945912 13828 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:51:44.945930 13828 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:51:44.945942 13828 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:51:44.945960 13828 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:44.945991 13828 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:44.946015 13828 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:51:44.946038 13828 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:51:44.947558 13828 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=37319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13828
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:44.947799 13828 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:44.948006 13828 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:44.957002 13840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:44.957036 13828 server_base.cc:1034] running on GCE node
W20260810 14:51:44.956995 13842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:44.956996 13837 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:44.957515 13828 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:44.957815 13828 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:44.958946 13828 hybrid_clock.cc:648] HybridClock initialized: now 1786373504958935 us; error 29 us; skew 500 ppm
Aug 10 14:51:44 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373504, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:44.961315 13828 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:51:44.961736 13828 webserver.cc:460] Webserver started at http://127.19.29.254:37319/ using document root <none> and password file <none>
I20260810 14:51:44.961993 13828 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:44.962062 13828 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:44.963413 13828 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:44.963987 13856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:44.964149 13828 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:44.964236 13828 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "d86905a5c2fe4968837a7e9b826459ec"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "e39da9b7a1d1458fad259a6502282834"
server_key_iv: "8e4dbfb7236b1a6883e0f9c6083ad10c"
server_key_version: "encryptionkey@0"
I20260810 14:51:44.964608 13828 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:44.974836 13828 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:44.976513 13828 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:44.976636 13828 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:44.980473 13828 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36257
I20260810 14:51:44.980518 13951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36257 every 8 connection(s)
I20260810 14:51:44.980860 13828 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:51:44.982265 13954 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:51:44.982959 13954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap starting.
I20260810 14:51:44.986523 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 13828
I20260810 14:51:44.986783 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:45401
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=45179
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:44.992295 13954 log.cc:824] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:44.994125 13954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:44.994478 13954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap complete.
I20260810 14:51:44.996616 13954 raft_consensus.cc:348] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:44.996835 13954 raft_consensus.cc:729] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Initialized, Role: FOLLOWER
I20260810 14:51:44.996980 13954 consensus_queue.cc:260] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:44.997046 13954 raft_consensus.cc:388] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:51:44.997095 13954 raft_consensus.cc:482] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:51:44.997143 13954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 1 FOLLOWER]: Advancing to term 2
I20260810 14:51:44.998109 13954 raft_consensus.cc:504] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:44.998201 13954 leader_election.cc:302] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d86905a5c2fe4968837a7e9b826459ec; no voters:
I20260810 14:51:44.998385 13954 leader_election.cc:288] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 2 election: Requested vote from peers
I20260810 14:51:44.998441 13958 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Leader election won for term 2
I20260810 14:51:44.998572 13958 raft_consensus.cc:686] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 LEADER]: Becoming Leader. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Running, Role: LEADER
I20260810 14:51:44.998654 13954 sys_catalog.cc:564] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:51:44.998728 13958 consensus_queue.cc:237] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:51:44.999023 13961 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:51:44.999056 13958 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader d86905a5c2fe4968837a7e9b826459ec. Latest consensus state: current_term: 2 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:51:44.999109 13961 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:44.999123 13958 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:51:44.999297 13969 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:51:45.000175 13969 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:51:45.000280 13969 catalog_manager.cc:1259] Loaded cluster ID: 9eabb63f76ed484b80d642934998dacc
I20260810 14:51:45.000313 13969 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:51:45.001157 13969 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:51:45.001336 13969 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Loaded TSK: 0
I20260810 14:51:45.016880 13969 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Generated new TSK 1
I20260810 14:51:45.016980 13969 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260810 14:51:45.072238 13956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:45.072425 13956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:45.072456 13956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:45.073570 13956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:45.073611 13956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:45.073644 13956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:51:45.075064 13956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:45401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=45179
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13956
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:45.075287 13956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:45.075491 13956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:45.080294 14001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:45.080299 13998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:45.080312 13997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:45.080919 13956 server_base.cc:1034] running on GCE node
I20260810 14:51:45.081097 13956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:45.081310 13956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:45.082448 13956 hybrid_clock.cc:648] HybridClock initialized: now 1786373505082437 us; error 30 us; skew 500 ppm
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:45.086156 13956 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:51:45.086571 13956 webserver.cc:460] Webserver started at http://127.19.29.193:45179/ using document root <none> and password file <none>
I20260810 14:51:45.086776 13956 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:45.086840 13956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:45.088105 13956 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:45.088743 14011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.088922 13956 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:51:45.089025 13956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "202df617d2fa258d8fac2e90bf80d961"
server_key_iv: "dde262a50abb99c69f239a69ba76a562"
server_key_version: "encryptionkey@0"
I20260810 14:51:45.089459 13956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:45.102484 13956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:45.104784 13956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:45.104924 13956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:45.105158 13956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:45.105684 14023 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:51:45.107152 13956 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:51:45.107214 13956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 14:51:45.107244 13956 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:51:45.108083 13956 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:51:45.108130 13956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 14:51:45.108197 14023 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap starting.
I20260810 14:51:45.115348 13956 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:45401
I20260810 14:51:45.115476 14228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:45401 every 8 connection(s)
I20260810 14:51:45.115805 13956 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:51:45.118587 14023 log.cc:824] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:45.121253 14023 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:51:45.121559 14023 tablet_bootstrap.cc:492] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap complete.
I20260810 14:51:45.122711 14023 ts_tablet_manager.cc:1397] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.010s
I20260810 14:51:45.122758 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 13956
I20260810 14:51:45.123044 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:38325
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=44609
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:45.124357 14023 raft_consensus.cc:348] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
I20260810 14:51:45.124665 14023 raft_consensus.cc:729] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac71b34b8974c09ae9346dcce1e1ac3, State: Initialized, Role: FOLLOWER
I20260810 14:51:45.124831 14023 consensus_queue.cc:260] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } } peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } }
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:45.125102 14023 ts_tablet_manager.cc:1428] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:51:45.129577 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.116605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56275 (local address 127.19.29.254:36257)
0810 14:51:45.118436 (+ 1831us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.118445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.118484 (+ 39us) server_negotiation.cc:407] Connection header received
0810 14:51:45.118616 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.118624 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.118688 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.118816 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:45.119443 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.120876 (+ 1433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.122360 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.122974 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.123566 (+ 592us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.125675 (+ 2109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:45.125679 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:45.125680 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:45.125692 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:45.127637 (+ 1945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.128105 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.128109 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.128109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.128220 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.128532 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.128533 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.128534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.128803 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:45.128876 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.129248 (+ 372us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.129382 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1777,"thread_start_us":82,"threads_started":1}
I20260810 14:51:45.129568 14234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.116494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:56275)
0810 14:51:45.116676 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.116725 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.117380 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.118868 (+ 1488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.118871 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.119130 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:45.119317 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.119322 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.121017 (+ 1695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.121019 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.122229 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.122233 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.123126 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.123127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.123276 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.123847 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:45.123857 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:45.125563 (+ 1706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:45.127721 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.127728 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.127730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.128003 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.128307 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.128309 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.128309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.128454 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.128882 (+ 428us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:45.128889 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:45.129061 (+ 172us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.129181 (+ 120us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.129351 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
I20260810 14:51:45.130393 14229 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:45.130504 14229 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:45.130681 14229 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:45.131825 13882 ts_manager.cc:194] Registered new tserver with Master: eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
I20260810 14:51:45.133016 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:56275
I20260810 14:51:45.134014 14229 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
I20260810 14:51:45.138914 14239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.132480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.0.0.1:36606)
0810 14:51:45.134394 (+ 1914us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.134435 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.134642 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.134945 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.134949 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.134951 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:45.135016 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.135017 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.136261 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.136262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.137587 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.137590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.138643 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.138644 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.138729 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.138743 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.138786 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.138836 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1879,"thread_start_us":84,"threads_started":1}
I20260810 14:51:45.139483 14241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.132729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.19.29.193:45401)
0810 14:51:45.134779 (+ 2050us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.134783 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.134792 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:51:45.134824 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.134826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.134841 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.135094 (+ 253us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:45.135144 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.136164 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.137686 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.138548 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.139275 (+ 727us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.139341 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.139367 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.139407 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2018,"thread_start_us":76,"threads_started":1}
I20260810 14:51:45.139935 14104 tablet_service.cc:1514] Processing DeleteTablet for tablet b872a75d8ad64937a7ea98a0ce6a9d56 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:24 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:36606
I20260810 14:51:45.140506 14242 tablet_replica.cc:330] stopping tablet replica
I20260810 14:51:45.140650 14242 raft_consensus.cc:2229] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:45.140756 14242 raft_consensus.cc:2258] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:45.141124 14242 ts_tablet_manager.cc:1905] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:45.143637 14242 ts_tablet_manager.cc:1918] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:45.143716 14242 log.cc:1196] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal/wals/b872a75d8ad64937a7ea98a0ce6a9d56
I20260810 14:51:45.143934 14242 ts_tablet_manager.cc:1939] T b872a75d8ad64937a7ea98a0ce6a9d56 P eac71b34b8974c09ae9346dcce1e1ac3: Deleting consensus metadata
I20260810 14:51:45.144423 13858 catalog_manager.cc:4841] TS eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401): tablet b872a75d8ad64937a7ea98a0ce6a9d56 (table test-table [id=c131972549014e11af35e687431aaf62]) successfully deleted
W20260810 14:51:45.210419 14237 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:45.210604 14237 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:45.210626 14237 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:45.211699 14237 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:45.211732 14237 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:45.211756 14237 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:51:45.213115 14237 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:38325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=44609
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14237
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:45.213286 14237 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:45.213456 14237 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:51:45.218482 14252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:45.218453 14260 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:45.218515 14237 server_base.cc:1034] running on GCE node
W20260810 14:51:45.218528 14255 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:45.218945 14237 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:45.219168 14237 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:45.220321 14237 hybrid_clock.cc:648] HybridClock initialized: now 1786373505220308 us; error 31 us; skew 500 ppm
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:45.222653 14237 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:51:45.223074 14237 webserver.cc:460] Webserver started at http://127.19.29.194:44609/ using document root <none> and password file <none>
I20260810 14:51:45.223261 14237 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:45.223320 14237 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:45.224521 14237 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:51:45.225010 14274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.225158 14237 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.225250 14237 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "60d0233f4d844b158a2e035b8b7265ba"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "99b3fc2fcfb85f9d01f5eec3170d8de5"
server_key_iv: "259ca3841915cd6f73e832f07be0a300"
server_key_version: "encryptionkey@0"
I20260810 14:51:45.225538 14237 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:45.241938 14237 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:45.243746 14237 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:45.243871 14237 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:45.244071 14237 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:45.244344 14237 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:45.244377 14237 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.244403 14237 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:45.244427 14237 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.249877 14237 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38325
I20260810 14:51:45.249913 14471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38325 every 8 connection(s)
I20260810 14:51:45.250217 14237 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:45.258544 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.250848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:42435 (local address 127.19.29.254:36257)
0810 14:51:45.250923 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.250926 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.251103 (+ 177us) server_negotiation.cc:407] Connection header received
0810 14:51:45.251575 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.251577 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.251591 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.251659 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:45.252537 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.253033 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.253967 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.254151 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.254193 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.256110 (+ 1917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:45.256111 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:45.256111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:45.256117 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:45.257281 (+ 1164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.257664 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.257665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.257666 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.257717 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.257920 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.257921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.257921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.258026 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:45.258079 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.258354 (+ 275us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.258444 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:51:45.258653 14478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.250839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:42435)
0810 14:51:45.250998 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.251032 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.251455 (+ 423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.251727 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.251731 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.252275 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:45.252447 (+ 172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.252452 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.253112 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.253113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.253906 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.253909 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.254216 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.254217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.254344 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.254751 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:45.254759 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:45.256016 (+ 1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:45.257363 (+ 1347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.257370 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.257372 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.257592 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.257770 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.257770 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.257771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.257866 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.258081 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:45.258087 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:45.258207 (+ 120us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.258313 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.258455 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":91,"threads_started":1}
I20260810 14:51:45.259059 14473 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:45.259146 14473 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:45.259318 14473 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:45.259676 13882 ts_manager.cc:194] Registered new tserver with Master: 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
I20260810 14:51:45.259691 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 14237
I20260810 14:51:45.259925 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:45243
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=33925
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:51:45.260062 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:42435
W20260810 14:51:45.339967 14479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:51:45.340158 14479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:51:45.340189 14479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:51:45.341310 14479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:51:45.341351 14479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:51:45.341385 14479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:51:45.342845 14479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:45243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=33925
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:51:45.343078 14479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:51:45.343272 14479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:51:45.348120 14479 server_base.cc:1034] running on GCE node
W20260810 14:51:45.348058 14489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:45.348032 14493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:51:45.348035 14488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:51:45.348426 14479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:51:45.348630 14479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:51:45.349762 14479 hybrid_clock.cc:648] HybridClock initialized: now 1786373505349753 us; error 27 us; skew 500 ppm
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:51:45.352139 14479 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:51:45.352541 14479 webserver.cc:460] Webserver started at http://127.19.29.195:33925/ using document root <none> and password file <none>
I20260810 14:51:45.352708 14479 fs_manager.cc:359] Metadata directory not provided
I20260810 14:51:45.352758 14479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:51:45.353962 14479 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:51:45.354498 14511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.354636 14479 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.354717 14479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "babe3da7e2004750bd409300dd67773b"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "0b96b3a11f7ff370694235deadabd3eb"
server_key_iv: "1dd463f4e39a99b37bfb0aa3f40dae23"
server_key_version: "encryptionkey@0"
I20260810 14:51:45.355008 14479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:51:45.376880 14479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:51:45.378527 14479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:51:45.378654 14479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:51:45.378837 14479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:51:45.379113 14479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:51:45.379146 14479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.379172 14479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:51:45.379200 14479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.384509 14479 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45243
I20260810 14:51:45.384546 14716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45243 every 8 connection(s)
I20260810 14:51:45.384845 14479 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:51:45.385249 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 14479
Aug 10 14:51:45 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373505, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:51:45.392138 14235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.385596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57512 (local address 127.19.29.254:36257)
0810 14:51:45.385701 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.385702 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.385845 (+ 143us) server_negotiation.cc:407] Connection header received
0810 14:51:45.385892 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.385893 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.385904 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.385953 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:45.386706 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.387219 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.388109 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.388366 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.388412 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.389662 (+ 1250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:45.389663 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:45.389664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:45.389670 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:45.391093 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.391387 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.391388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.391388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.391447 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.391644 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.391644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.391644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.391734 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:45.391864 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.391922 (+ 58us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.392037 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":56,"threads_started":1}
I20260810 14:51:45.394395 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.385548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:46507 (local address 127.19.29.254:36257)
0810 14:51:45.385698 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.385700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.386058 (+ 358us) server_negotiation.cc:407] Connection header received
0810 14:51:45.386708 (+ 650us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.386708 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.386721 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.386777 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:45.387733 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.388238 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.389530 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.389767 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.389828 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.391863 (+ 2035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:45.391864 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:45.391864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:45.391871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:45.393282 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.393607 (+ 325us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.393607 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.393607 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.393655 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.393867 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.393868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.393868 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.393962 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:45.394007 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.394245 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.394335 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260810 14:51:45.394572 14723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.385572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:46507)
0810 14:51:45.385938 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.385983 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.386596 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.386827 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.386830 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.387405 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:51:45.387648 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.387654 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.388315 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.388316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.389452 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.389455 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.389851 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.389852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.389954 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.390345 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:51:45.390353 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:51:45.391781 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:51:45.393342 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.393348 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.393350 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.393545 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.393699 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:51:45.393700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:51:45.393700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:51:45.393792 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:51:45.394008 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:51:45.394012 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:51:45.394124 (+ 112us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.394229 (+ 105us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.394377 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":82,"threads_started":1}
I20260810 14:51:45.395023 14718 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36257
I20260810 14:51:45.395109 14718 heartbeater.cc:464] Registering TS with master...
I20260810 14:51:45.395269 14718 heartbeater.cc:511] Master 127.19.29.254:36257 requested a full tablet report, sending...
I20260810 14:51:45.395581 13882 ts_manager.cc:194] Registered new tserver with Master: babe3da7e2004750bd409300dd67773b (127.19.29.195:45243)
I20260810 14:51:45.395913 13882 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:46507
I20260810 14:51:45.403713 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:51:45.406055 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.404018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57520 (local address 127.19.29.254:36257)
0810 14:51:45.404088 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.404090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.404163 (+ 73us) server_negotiation.cc:407] Connection header received
0810 14:51:45.404219 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.404219 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.404250 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.404305 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:45.404392 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.404832 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.405540 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.405715 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.405755 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.405853 (+ 98us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:45.405889 (+ 36us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0810 14:51:45.405997 (+ 108us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57520: token expired
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 14:51:45.406108 14721 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57520: token expired
W20260810 14:51:45.406260 13763 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.19.29.254:36257)
I20260810 14:51:45.411217 14721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.406480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57530 (local address 127.19.29.254:36257)
0810 14:51:45.406532 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.406534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.406553 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:51:45.406570 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.406570 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.406579 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.406619 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:51:45.407032 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.407457 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.408097 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.408268 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.408317 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.409259 (+ 942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:51:45.409260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:51:45.409261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:51:45.409266 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:51:45.410238 (+ 972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.410537 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.410538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.410538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.410590 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:51:45.410749 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:51:45.410750 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:51:45.410750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:51:45.410870 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:51:45.410956 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.411069 (+ 113us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.411136 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:51:45.412230 13882 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:51:45.413708 13882 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:51:45.415724 14104 tablet_service.cc:1467] Processing CreateTablet for tablet d8e964c9fc904d3e870d47d6d0845d0e (DEFAULT_TABLE table=test-table [id=4ea4e5a6682c49d6bd7f718059bafab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:45.415915 14104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8e964c9fc904d3e870d47d6d0845d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:45.417196 14023 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap starting.
I20260810 14:51:45.417510 14023 tablet_bootstrap.cc:654] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:45.417963 14023 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: No bootstrap required, opened a new log
I20260810 14:51:45.418007 14023 ts_tablet_manager.cc:1397] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260810 14:51:45.418131 14023 raft_consensus.cc:348] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.418198 14023 raft_consensus.cc:374] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:45.418242 14023 raft_consensus.cc:729] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac71b34b8974c09ae9346dcce1e1ac3, State: Initialized, Role: FOLLOWER
I20260810 14:51:45.418308 14023 consensus_queue.cc:260] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.418406 14023 ts_tablet_manager.cc:1428] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260810 14:51:45.418956 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.415419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38325 (local address 127.0.0.1:41420)
0810 14:51:45.415782 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.415791 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.415844 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.416050 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.416051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.416053 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:45.416098 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.416100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.417007 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.417008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.417821 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.417823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.418730 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.418731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.418794 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.418798 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.418850 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.418890 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":347,"mutex_wait_us":14,"thread_start_us":88,"threads_started":1}
I20260810 14:51:45.418993 14732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.415589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41420 (local address 127.19.29.194:38325)
0810 14:51:45.415763 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.415768 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.415910 (+ 142us) server_negotiation.cc:407] Connection header received
0810 14:51:45.415957 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.415960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.415977 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.416054 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:45.416144 (+ 90us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.416932 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.417904 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.418645 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.418708 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.418765 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.418873 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.418913 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260810 14:51:45.419623 14357 tablet_service.cc:1467] Processing CreateTablet for tablet d8e964c9fc904d3e870d47d6d0845d0e (DEFAULT_TABLE table=test-table [id=4ea4e5a6682c49d6bd7f718059bafab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:45.419931 14357 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8e964c9fc904d3e870d47d6d0845d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:45.421582 14239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.415420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45243 (local address 127.0.0.1:36220)
0810 14:51:45.415563 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.415573 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.415614 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.418111 (+ 2497us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.418112 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.418114 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:45.418148 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.418150 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.419698 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.419699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.420451 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.420453 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.421400 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.421401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.421446 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.421449 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.421510 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.421540 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127}
I20260810 14:51:45.421638 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.417274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36220 (local address 127.19.29.195:45243)
0810 14:51:45.417957 (+ 683us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.417962 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.417981 (+ 19us) server_negotiation.cc:407] Connection header received
0810 14:51:45.418015 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.418017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.418030 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.418108 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:45.418210 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.419607 (+ 1397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.420561 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.421323 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.421399 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.421450 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.421524 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.421561 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":651,"thread_start_us":94,"threads_started":1}
I20260810 14:51:45.422922 14736 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Bootstrap starting.
I20260810 14:51:45.422894 14601 tablet_service.cc:1467] Processing CreateTablet for tablet d8e964c9fc904d3e870d47d6d0845d0e (DEFAULT_TABLE table=test-table [id=4ea4e5a6682c49d6bd7f718059bafab4]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:51:45.423206 14601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8e964c9fc904d3e870d47d6d0845d0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:51:45.423527 14736 tablet_bootstrap.cc:654] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:45.423955 14736 log.cc:824] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:45.424561 14736 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: No bootstrap required, opened a new log
I20260810 14:51:45.424604 14736 ts_tablet_manager.cc:1397] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:51:45.425711 14741 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Bootstrap starting.
I20260810 14:51:45.426033 14736 raft_consensus.cc:348] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.426209 14736 raft_consensus.cc:374] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:45.426254 14736 raft_consensus.cc:729] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60d0233f4d844b158a2e035b8b7265ba, State: Initialized, Role: FOLLOWER
I20260810 14:51:45.426396 14741 tablet_bootstrap.cc:654] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Neither blocks nor log segments found. Creating new log.
I20260810 14:51:45.426398 14736 consensus_queue.cc:260] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.426697 14473 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
I20260810 14:51:45.426956 14736 ts_tablet_manager.cc:1428] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:51:45.427016 14741 log.cc:824] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:51:45.427872 14741 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: No bootstrap required, opened a new log
I20260810 14:51:45.427934 14741 ts_tablet_manager.cc:1397] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:51:45.429304 14741 raft_consensus.cc:348] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.429427 14741 raft_consensus.cc:374] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:51:45.429458 14741 raft_consensus.cc:729] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: babe3da7e2004750bd409300dd67773b, State: Initialized, Role: FOLLOWER
I20260810 14:51:45.429562 14741 consensus_queue.cc:260] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.429785 14741 ts_tablet_manager.cc:1428] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:51:45.429816 14718 heartbeater.cc:503] Master 127.19.29.254:36257 was elected leader, sending a full tablet report...
W20260810 14:51:45.500756 14475 tablet.cc:2369] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:51:45.535085 14750 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:51:45.535207 14750 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.535517 14750 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325), eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
I20260810 14:51:45.538125 14241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.535729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:34335 (local address 127.19.29.193:45401)
0810 14:51:45.535775 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.535777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.535787 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:51:45.535876 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.535877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.535886 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.535928 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:45.536087 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.536569 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537439 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.537811 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537873 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.537882 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.538021 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.538058 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:51:45.538125 14723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.535664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.19.29.195:34335)
0810 14:51:45.535740 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.535751 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.535790 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.535947 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.535949 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.535950 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:45.536015 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.536017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.536639 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.536640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.537354 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.537356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.537882 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.537958 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.537961 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.538005 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.538045 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 14:51:45.538221 14732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.535761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:59559 (local address 127.19.29.194:38325)
0810 14:51:45.535829 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.535831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.535919 (+ 88us) server_negotiation.cc:407] Connection header received
0810 14:51:45.535975 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.535976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.535986 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.536034 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:51:45.536177 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.536632 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537538 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.537907 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537967 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.537975 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.538125 (+ 150us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.538162 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 14:51:45.538224 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.535665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38325 (local address 127.19.29.195:59559)
0810 14:51:45.535846 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.535856 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:51:45.535921 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:51:45.536043 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:51:45.536044 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:51:45.536045 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:51:45.536118 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.536120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.536703 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.536704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.537450 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:51:45.537452 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.537981 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.537982 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:51:45.538063 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.538066 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:51:45.538109 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:51:45.538143 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":14,"thread_start_us":95,"threads_started":1}
I20260810 14:51:45.538483 14135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8e964c9fc904d3e870d47d6d0845d0e" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" is_pre_election: true
I20260810 14:51:45.538650 14135 raft_consensus.cc:2454] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 0.
I20260810 14:51:45.538633 14393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8e964c9fc904d3e870d47d6d0845d0e" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d0233f4d844b158a2e035b8b7265ba" is_pre_election: true
I20260810 14:51:45.538789 14393 raft_consensus.cc:2454] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 0.
I20260810 14:51:45.538867 14512 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: babe3da7e2004750bd409300dd67773b, eac71b34b8974c09ae9346dcce1e1ac3; no voters:
I20260810 14:51:45.538988 14750 raft_consensus.cc:2781] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:51:45.539044 14750 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:51:45.539060 14750 raft_consensus.cc:3037] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:45.541880 14750 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.542006 14750 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 election: Requested vote from peers 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325), eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401)
I20260810 14:51:45.542165 14135 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8e964c9fc904d3e870d47d6d0845d0e" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
I20260810 14:51:45.542160 14393 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8e964c9fc904d3e870d47d6d0845d0e" candidate_uuid: "babe3da7e2004750bd409300dd67773b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60d0233f4d844b158a2e035b8b7265ba"
I20260810 14:51:45.542244 14135 raft_consensus.cc:3037] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:45.542244 14393 raft_consensus.cc:3037] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:51:45.543187 14393 raft_consensus.cc:2454] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 1.
I20260810 14:51:45.543365 14519 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b; no voters:
I20260810 14:51:45.543511 14750 raft_consensus.cc:2781] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:51:45.543514 14135 raft_consensus.cc:2454] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate babe3da7e2004750bd409300dd67773b in term 1.
I20260810 14:51:45.543694 14750 raft_consensus.cc:686] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 1 LEADER]: Becoming Leader. State: Replica: babe3da7e2004750bd409300dd67773b, State: Running, Role: LEADER
I20260810 14:51:45.543792 14750 consensus_queue.cc:237] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:51:45.544588 13880 catalog_manager.cc:5495] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b reported cstate change: term changed from 0 to 1, leader changed from <none> to babe3da7e2004750bd409300dd67773b (127.19.29.195). New cstate: current_term: 1 leader_uuid: "babe3da7e2004750bd409300dd67773b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } health_report { overall_health: UNKNOWN } } }
I20260810 14:51:45.561643 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.559583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36236 (local address 127.19.29.195:45243)
0810 14:51:45.559638 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:51:45.559640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:51:45.559648 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:51:45.559702 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:51:45.559703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:51:45.559719 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:51:45.559775 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:51:45.559881 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.560322 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.560988 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:51:45.561168 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:51:45.561221 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:51:45.561355 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:51:45.561445 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:51:45.561519 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0810 14:51:45.561543 (+ 24us) server_negotiation.cc:299] Negotiation successful
0810 14:51:45.561562 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:51:45.563203 14135 raft_consensus.cc:1261] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Refusing update from remote peer babe3da7e2004750bd409300dd67773b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:45.563203 14393 raft_consensus.cc:1261] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Refusing update from remote peer babe3da7e2004750bd409300dd67773b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:51:45.563467 14750 consensus_queue.cc:1035] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [LEADER]: Connected to new peer: Peer: permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:45.563602 14757 consensus_queue.cc:1035] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [LEADER]: Connected to new peer: Peer: permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:51:45.565681 14761 mvcc.cc:205] Tried to move back new op lower bound from 7316985878784798720 to 7316985878708142080. Current Snapshot: MvccSnapshot[applied={T|T < 7316985878784798720}]
I20260810 14:51:45.565912 14763 mvcc.cc:205] Tried to move back new op lower bound from 7316985878784798720 to 7316985878708142080. Current Snapshot: MvccSnapshot[applied={T|T < 7316985878784798720}]
I20260810 14:51:45.566116 14762 mvcc.cc:205] Tried to move back new op lower bound from 7316985878784798720 to 7316985878708142080. Current Snapshot: MvccSnapshot[applied={T|T < 7316985878784798720}]
I20260810 14:51:45.567898 13880 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:45.567977 13880 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:51:45.568629 13880 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Sending DeleteTablet for 3 replicas of tablet d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:51:45.568902 14601 tablet_service.cc:1514] Processing DeleteTablet for tablet d8e964c9fc904d3e870d47d6d0845d0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:45 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:36220
I20260810 14:51:45.568931 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 13956
I20260810 14:51:45.568936 14357 tablet_service.cc:1514] Processing DeleteTablet for tablet d8e964c9fc904d3e870d47d6d0845d0e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:51:45 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:41420
I20260810 14:51:45.569180 14780 tablet_replica.cc:330] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: stopping tablet replica
I20260810 14:51:45.569272 14780 raft_consensus.cc:2229] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:51:45.569375 14780 raft_consensus.cc:2258] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:45.573835 14780 ts_tablet_manager.cc:1905] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:45.575414 14780 ts_tablet_manager.cc:1918] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:45.575502 14780 log.cc:1196] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:51:45.575752 14780 ts_tablet_manager.cc:1939] T d8e964c9fc904d3e870d47d6d0845d0e P babe3da7e2004750bd409300dd67773b: Deleting consensus metadata
I20260810 14:51:45.576092 13860 catalog_manager.cc:4841] TS babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): tablet d8e964c9fc904d3e870d47d6d0845d0e (table test-table [id=4ea4e5a6682c49d6bd7f718059bafab4]) successfully deleted
I20260810 14:51:45.578735 14781 tablet_replica.cc:330] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: stopping tablet replica
I20260810 14:51:45.578863 14781 raft_consensus.cc:2229] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:51:45.579005 14781 raft_consensus.cc:2258] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:51:45.581773 14781 ts_tablet_manager.cc:1905] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:51:45.583231 14781 ts_tablet_manager.cc:1918] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:51:45.583318 14781 log.cc:1196] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:51:45.583563 14781 ts_tablet_manager.cc:1939] T d8e964c9fc904d3e870d47d6d0845d0e P 60d0233f4d844b158a2e035b8b7265ba: Deleting consensus metadata
I20260810 14:51:45.583909 13863 catalog_manager.cc:4841] TS 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): tablet d8e964c9fc904d3e870d47d6d0845d0e (table test-table [id=4ea4e5a6682c49d6bd7f718059bafab4]) successfully deleted
W20260810 14:51:45.593163 13858 connection.cc:535] client connection to 127.19.29.193:45401 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260810 14:51:45.593283 13858 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:51:45.593636 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 14237
I20260810 14:51:45.593761 14239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:51:45.593634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:45401 (local address 127.0.0.1:36610)
0810 14:51:45.593687 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 14:51:45.593732 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45401: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260810 14:51:45.610972 13858 catalog_manager.cc:4584] TS eac71b34b8974c09ae9346dcce1e1ac3 (127.19.29.193:45401): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8e964c9fc904d3e870d47d6d0845d0e: Network error: Client connection negotiation failed: client connection to 127.19.29.193:45401: connect: Connection refused (error 111)
I20260810 14:51:45.615882 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 14479
I20260810 14:51:45.625007 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 13828
I20260810 14:52:05.636184 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--webserver_interface=127.19.29.254
--webserver_port=37319
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36257
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:05.717674 14789 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:05.717866 14789 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:05.717886 14789 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:05.718976 14789 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260810 14:52:05.719008 14789 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260810 14:52:05.719019 14789 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260810 14:52:05.719029 14789 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:05.719041 14789 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:05.719058 14789 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:05.719069 14789 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:05.719086 14789 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:05.720502 14789 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36257
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36257
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=37319
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14789
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:05.720698 14789 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:05.720863 14789 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:05.725984 14804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:05.726039 14806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:05.726022 14803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:05.726054 14789 server_base.cc:1034] running on GCE node
I20260810 14:52:05.726442 14789 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:05.726733 14789 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:05.727883 14789 hybrid_clock.cc:648] HybridClock initialized: now 1786373525727869 us; error 29 us; skew 500 ppm
Aug 10 14:52:05 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373525, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:05.730273 14789 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:05.730773 14789 webserver.cc:460] Webserver started at http://127.19.29.254:37319/ using document root <none> and password file <none>
I20260810 14:52:05.730996 14789 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:05.731046 14789 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:05.732301 14789 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:05.732987 14821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:05.733196 14789 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:05.733295 14789 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "d86905a5c2fe4968837a7e9b826459ec"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "e39da9b7a1d1458fad259a6502282834"
server_key_iv: "8e4dbfb7236b1a6883e0f9c6083ad10c"
server_key_version: "encryptionkey@0"
I20260810 14:52:05.733654 14789 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:05.757867 14789 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:05.759999 14789 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:05.760151 14789 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:05.764254 14789 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36257
I20260810 14:52:05.764287 14924 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36257 every 8 connection(s)
I20260810 14:52:05.764667 14789 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:05.766232 14926 sys_catalog.cc:263] Verifying existing consensus state
I20260810 14:52:05.766983 14926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap starting.
I20260810 14:52:05.772418 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 14789
I20260810 14:52:05.772768 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:45401
--local_ip_for_outbound_sockets=127.19.29.193
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=45179
--webserver_interface=127.19.29.193
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:52:05.776681 14926 log.cc:824] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:05.779016 14926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:52:05.779285 14926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Bootstrap complete.
I20260810 14:52:05.781378 14926 raft_consensus.cc:348] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:52:05.781601 14926 raft_consensus.cc:729] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Initialized, Role: FOLLOWER
I20260810 14:52:05.781749 14926 consensus_queue.cc:260] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:52:05.781806 14926 raft_consensus.cc:388] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:05.781844 14926 raft_consensus.cc:482] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:05.781890 14926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 2 FOLLOWER]: Advancing to term 3
I20260810 14:52:05.782893 14926 raft_consensus.cc:504] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:52:05.782984 14926 leader_election.cc:302] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d86905a5c2fe4968837a7e9b826459ec; no voters:
I20260810 14:52:05.783144 14926 leader_election.cc:288] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [CANDIDATE]: Term 3 election: Requested vote from peers
I20260810 14:52:05.783190 14937 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 3 FOLLOWER]: Leader election won for term 3
I20260810 14:52:05.783363 14937 raft_consensus.cc:686] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [term 3 LEADER]: Becoming Leader. State: Replica: d86905a5c2fe4968837a7e9b826459ec, State: Running, Role: LEADER
I20260810 14:52:05.783406 14926 sys_catalog.cc:564] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:05.783675 14937 consensus_queue.cc:237] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } }
I20260810 14:52:05.783993 14940 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:52:05.784080 14940 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:05.784349 14939 sys_catalog.cc:455] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader d86905a5c2fe4968837a7e9b826459ec. Latest consensus state: current_term: 3 leader_uuid: "d86905a5c2fe4968837a7e9b826459ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d86905a5c2fe4968837a7e9b826459ec" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36257 } } }
I20260810 14:52:05.784407 14950 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:05.784484 14939 sys_catalog.cc:458] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:05.785301 14950 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:05.785468 14950 catalog_manager.cc:1259] Loaded cluster ID: 9eabb63f76ed484b80d642934998dacc
I20260810 14:52:05.785665 14950 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:05.786958 14950 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:05.787191 14950 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Loaded TSK: 0
I20260810 14:52:05.787258 14950 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d86905a5c2fe4968837a7e9b826459ec: Loaded TSK: 1
F20260810 14:52:05.787518 14950 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f475dac39ad google::LogMessage::Fail() at ??:0
@ 0x7f475dac688a google::LogMessage::SendToLog() at ??:0
@ 0x7f475dac34de google::LogMessage::Flush() at ??:0
@ 0x7f475dac4a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f4760230104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f476022dd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f4765a211cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f4765a2148e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f4765a21594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f47659e7c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f47659f1ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f475f9910d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f475f986954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f47607ea6db start_thread at ??:0
@ 0x7f475c5c161f clone at ??:0
W20260810 14:52:05.888749 14933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:05.888936 14933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:05.888958 14933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:05.890091 14933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:05.890129 14933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:05.890154 14933 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:05.891661 14933 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:45401
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=45179
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:05.891883 14933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:05.892094 14933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:05.896981 15005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:05.897189 15000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:05.897141 14933 server_base.cc:1034] running on GCE node
W20260810 14:52:05.897044 14999 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:05.897502 14933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:05.897770 14933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:05.898947 14933 hybrid_clock.cc:648] HybridClock initialized: now 1786373525898930 us; error 32 us; skew 500 ppm
Aug 10 14:52:05 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373525, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:05.902029 14933 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:52:05.902500 14933 webserver.cc:460] Webserver started at http://127.19.29.193:45179/ using document root <none> and password file <none>
I20260810 14:52:05.902733 14933 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:05.902782 14933 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:05.904147 14933 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:05.904848 15017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:05.905033 14933 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:05.905136 14933 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "eac71b34b8974c09ae9346dcce1e1ac3"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "202df617d2fa258d8fac2e90bf80d961"
server_key_iv: "dde262a50abb99c69f239a69ba76a562"
server_key_version: "encryptionkey@0"
I20260810 14:52:05.905471 14933 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:05.928368 14933 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:05.930519 14933 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:05.930660 14933 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:05.930876 14933 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:05.931320 15035 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260810 14:52:05.933272 14933 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260810 14:52:05.933319 14933 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260810 14:52:05.933350 14933 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260810 14:52:05.933970 14933 ts_tablet_manager.cc:610] Registered 1 tablets
I20260810 14:52:05.934001 14933 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260810 14:52:05.934103 15035 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap starting.
I20260810 14:52:05.940712 14933 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:45401
I20260810 14:52:05.940810 15233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:45401 every 8 connection(s)
I20260810 14:52:05.941144 14933 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:52:05.945833 15035 log.cc:824] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:05.948618 15035 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260810 14:52:05.948931 15035 tablet_bootstrap.cc:492] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Bootstrap complete.
I20260810 14:52:05.949250 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 14933
I20260810 14:52:05.949493 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:38325
--local_ip_for_outbound_sockets=127.19.29.194
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=44609
--webserver_interface=127.19.29.194
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:52:05.950182 15035 ts_tablet_manager.cc:1397] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.009s
I20260810 14:52:05.951828 15035 raft_consensus.cc:348] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:05.952296 15035 raft_consensus.cc:729] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eac71b34b8974c09ae9346dcce1e1ac3, State: Initialized, Role: FOLLOWER
I20260810 14:52:05.952450 15035 consensus_queue.cc:260] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:05.952759 15035 ts_tablet_manager.cc:1428] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3: Time spent starting tablet: real 0.003s user 0.000s sys 0.006s
W20260810 14:52:06.002055 15237 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:05.941808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:60901)
0810 14:52:05.941970 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:05.942013 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:05.942488 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:06.001833 (+ 59345us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":75,"threads_started":1}
W20260810 14:52:06.002354 15235 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:36257 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:36257: Client connection negotiation failed: client connection to 127.19.29.254:36257: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260810 14:52:06.002735 15237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.002601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:34489)
0810 14:52:06.002652 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.002707 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:52:06.003058 15237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.002965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:39675)
0810 14:52:06.003011 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.003039 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260810 14:52:06.003166 15235 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:52:06.032814 15244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:06.032996 15244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:06.033018 15244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:06.034133 15244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:06.034173 15244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:06.034200 15244 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:06.035669 15244 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:38325
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=44609
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:06.035871 15244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:06.036073 15244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:06.040884 15261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:06.040937 15244 server_base.cc:1034] running on GCE node
W20260810 14:52:06.041007 15263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:06.040899 15258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:06.041278 15244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:06.041517 15244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:06.042696 15244 hybrid_clock.cc:648] HybridClock initialized: now 1786373526042682 us; error 29 us; skew 500 ppm
Aug 10 14:52:06 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373526, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:06.045042 15244 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:52:06.045433 15244 webserver.cc:460] Webserver started at http://127.19.29.194:44609/ using document root <none> and password file <none>
I20260810 14:52:06.045641 15244 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:06.045681 15244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:06.046955 15244 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:06.047475 15275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.047638 15244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:06.047710 15244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "60d0233f4d844b158a2e035b8b7265ba"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "99b3fc2fcfb85f9d01f5eec3170d8de5"
server_key_iv: "259ca3841915cd6f73e832f07be0a300"
server_key_version: "encryptionkey@0"
I20260810 14:52:06.047993 15244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:06.058524 15244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:06.060472 15244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:06.060590 15244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:06.060763 15244 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:06.060998 15244 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:06.061026 15244 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.061044 15244 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:06.061060 15244 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.066606 15244 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:38325
I20260810 14:52:06.066676 15466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:38325 every 8 connection(s)
I20260810 14:52:06.066951 15244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:06.068032 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.067682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:42109)
0810 14:52:06.067831 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.067898 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
W20260810 14:52:06.068410 15471 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:36257 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:36257: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
I20260810 14:52:06.068657 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.068574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:44315)
0810 14:52:06.068612 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.068636 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 14:52:06.068804 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 15244
I20260810 14:52:06.068981 15475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.068880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:58785)
0810 14:52:06.068922 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.068956 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 14:52:06.069082 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:45243
--local_ip_for_outbound_sockets=127.19.29.195
--tserver_master_addrs=127.19.29.254:36257
--webserver_port=33925
--webserver_interface=127.19.29.195
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:06.069113 15471 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260810 14:52:06.150903 15476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:06.151093 15476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:06.151116 15476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:06.152320 15476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:06.152364 15476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:06.152388 15476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:06.153836 15476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:45243
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=33925
--tserver_master_addrs=127.19.29.254:36257
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:06.154024 15476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:06.154191 15476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:06.159166 15490 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:06.159286 15476 server_base.cc:1034] running on GCE node
W20260810 14:52:06.159214 15491 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:06.159179 15493 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:06.159624 15476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:06.159869 15476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:06.161005 15476 hybrid_clock.cc:648] HybridClock initialized: now 1786373526160985 us; error 37 us; skew 500 ppm
Aug 10 14:52:06 dist-test-slave-4tdj krb5kdc[12905](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373526, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:06.163426 15476 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:52:06.163823 15476 webserver.cc:460] Webserver started at http://127.19.29.195:33925/ using document root <none> and password file <none>
I20260810 14:52:06.164047 15476 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:06.164096 15476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:06.165445 15476 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:06.166155 15506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.166343 15476 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:06.166430 15476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "babe3da7e2004750bd409300dd67773b"
format_stamp: "Formatted at 2026-08-10 14:51:24 on dist-test-slave-4tdj"
server_key: "0b96b3a11f7ff370694235deadabd3eb"
server_key_iv: "1dd463f4e39a99b37bfb0aa3f40dae23"
server_key_version: "encryptionkey@0"
I20260810 14:52:06.166772 15476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:06.187295 15476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:06.189393 15476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:06.189529 15476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:06.189759 15476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:06.190065 15476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:06.190106 15476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.190137 15476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:06.190155 15476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:06.195838 15476 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45243
I20260810 14:52:06.195892 15709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45243 every 8 connection(s)
I20260810 14:52:06.196221 15476 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:06.197209 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.196854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:47793)
0810 14:52:06.196995 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.197067 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
W20260810 14:52:06.197590 15710 heartbeater.cc:644] Failed to heartbeat to 127.19.29.254:36257 (0 consecutive failures): Network error: Failed to ping master at 127.19.29.254:36257: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
I20260810 14:52:06.197821 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.197742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:42567)
0810 14:52:06.197779 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.197804 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260810 14:52:06.198024 15712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:06.197962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:35511)
0810 14:52:06.197991 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:06.198008 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260810 14:52:06.198103 15710 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260810 14:52:06.205452 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 15476
I20260810 14:52:07.003753 15715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.003511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:45141)
0810 14:52:07.003641 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:07.003687 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260810 14:52:07.069605 15716 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.069372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:35873)
0810 14:52:07.069483 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:07.069521 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":55,"threads_started":1}
I20260810 14:52:07.198621 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.198430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:36571)
0810 14:52:07.198544 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:07.198572 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":56,"threads_started":1}
I20260810 14:52:07.563421 15721 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:07.563544 15721 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:07.563894 15721 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
Aug 10 14:52:07 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373525, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.194@KRBTEST.COM
Aug 10 14:52:07 dist-test-slave-4tdj krb5kdc[12905](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373525, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.195@KRBTEST.COM
I20260810 14:52:07.573577 15725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.564160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:44553 (local address 127.19.29.194:38325)
0810 14:52:07.564309 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:07.564322 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:07.564354 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:52:07.564816 (+ 462us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:07.564818 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:07.564855 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:07.564976 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:07.565705 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.566611 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.567576 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.568058 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.568156 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:07.570339 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:07.570344 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:07.570344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:07.570355 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:07.572065 (+ 1710us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572419 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:07.572422 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:07.572423 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:07.572518 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572739 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:07.572740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:07.572740 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:07.572964 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:07.573041 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:07.573338 (+ 297us) server_negotiation.cc:299] Negotiation successful
0810 14:52:07.573454 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":53,"threads_started":1}
I20260810 14:52:07.573587 15726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.564208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:55973 (local address 127.19.29.195:45243)
0810 14:52:07.564346 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:07.564356 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:07.564384 (+ 28us) server_negotiation.cc:407] Connection header received
0810 14:52:07.564810 (+ 426us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:07.564812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:07.564855 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:07.564980 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:07.565720 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.566603 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.567589 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.568111 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.568424 (+ 313us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:07.570699 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:07.570703 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:07.570704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:07.570714 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:07.572220 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572537 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:07.572540 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:07.572540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:07.572631 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572801 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:07.572802 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:07.572802 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:07.573009 (+ 207us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:07.573078 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:07.573339 (+ 261us) server_negotiation.cc:299] Negotiation successful
0810 14:52:07.573454 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":73,"threads_started":1}
I20260810 14:52:07.573583 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.564072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:38325 (local address 127.19.29.193:44553)
0810 14:52:07.564222 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:07.564231 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:07.564288 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:07.565035 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:07.565053 (+ 18us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:07.565411 (+ 358us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:07.565597 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:07.565602 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.566699 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.566700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:07.567495 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:07.567497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.568140 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.568141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:07.568268 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:07.568761 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:07.568771 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:07.570222 (+ 1451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:07.572141 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572148 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:07.572150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:07.572350 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:07.572582 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572582 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:07.572583 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:07.572683 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:07.573026 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:07.573033 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:07.573188 (+ 155us) client_negotiation.cc:769] Sending connection context
0810 14:52:07.573275 (+ 87us) client_negotiation.cc:240] Negotiation successful
0810 14:52:07.573453 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":49,"thread_start_us":77,"threads_started":1}
I20260810 14:52:07.573904 15722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:07.564036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45243 (local address 127.19.29.193:55973)
0810 14:52:07.564151 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:07.564167 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:07.564226 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:07.565037 (+ 811us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:07.565040 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:07.565410 (+ 370us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:07.565596 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:07.565602 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.566693 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.566694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:07.567496 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:07.567498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:07.568212 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:07.568213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:07.568271 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:07.568900 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:07.568906 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:07.570599 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:07.572310 (+ 1711us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:07.572311 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:07.572467 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:07.572691 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:07.572692 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:07.572692 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:07.572751 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:07.573084 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:07.573085 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:07.573188 (+ 103us) client_negotiation.cc:769] Sending connection context
0810 14:52:07.573277 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 14:52:07.573527 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":170,"thread_start_us":48,"threads_started":1}
W20260810 14:52:07.574383 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:07.574764 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:07.574811 15020 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:07.574916 15721 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:08.004374 15724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:08.004216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:54855)
0810 14:52:08.004286 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:08.004330 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:52:08.070269 15727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:08.070029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:51677)
0810 14:52:08.070181 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:08.070217 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":82,"threads_started":1}
I20260810 14:52:08.199240 15728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:08.199024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:32873)
0810 14:52:08.199161 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:08.199200 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":62,"threads_started":1}
I20260810 14:52:09.005028 15729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:09.004831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:45557)
0810 14:52:09.004949 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:09.004982 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":66,"threads_started":1}
I20260810 14:52:09.070856 15732 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:09.070667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:51503)
0810 14:52:09.070783 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:09.070817 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
I20260810 14:52:09.199903 15734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:09.199694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:55779)
0810 14:52:09.199820 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:09.199855 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260810 14:52:09.463603 15736 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:09.463699 15736 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:09.463868 15736 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
W20260810 14:52:09.464287 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:09.464352 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:09.464421 15030 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:09.464516 15736 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:10.005800 15737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:10.005541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:44643)
0810 14:52:10.005697 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:10.005741 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260810 14:52:10.071568 15741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:10.071274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:39103)
0810 14:52:10.071440 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:10.071506 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":84,"threads_started":1}
I20260810 14:52:10.200502 15742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:10.200311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:54821)
0810 14:52:10.200430 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:10.200465 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":59,"threads_started":1}
I20260810 14:52:11.006613 15745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:11.006374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:38881)
0810 14:52:11.006496 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:11.006564 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":64,"threads_started":1}
I20260810 14:52:11.072204 15746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:11.071999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:39499)
0810 14:52:11.072123 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:11.072162 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":57,"threads_started":1}
I20260810 14:52:11.201089 15748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:11.200901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:47627)
0810 14:52:11.201011 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:11.201045 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":58,"threads_started":1}
I20260810 14:52:11.530370 15750 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:11.530467 15750 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:11.530648 15750 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
W20260810 14:52:11.531045 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:11.531147 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:11.531206 15030 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:11.531293 15750 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:12.007306 15753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:12.007072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:43445)
0810 14:52:12.007222 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:12.007260 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":96,"threads_started":1}
I20260810 14:52:12.072829 15756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:12.072616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:34559)
0810 14:52:12.072740 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:12.072777 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":68,"threads_started":1}
I20260810 14:52:12.201715 15757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:12.201513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:56493)
0810 14:52:12.201642 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:12.201677 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260810 14:52:13.007946 15760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:13.007724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:45479)
0810 14:52:13.007862 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:13.007900 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":88,"threads_started":1}
I20260810 14:52:13.073511 15761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:13.073286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:46657)
0810 14:52:13.073428 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:13.073465 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":78,"threads_started":1}
I20260810 14:52:13.202427 15763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:13.202191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:60989)
0810 14:52:13.202351 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:13.202386 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":65,"threads_started":1}
I20260810 14:52:14.008533 15765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:14.008341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:60365)
0810 14:52:14.008454 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:14.008488 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":65,"threads_started":1}
I20260810 14:52:14.074081 15766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:14.073867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:52917)
0810 14:52:14.073996 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:14.074040 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":59,"threads_started":1}
I20260810 14:52:14.203083 15767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:14.202836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:34655)
0810 14:52:14.202990 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:14.203037 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":78,"threads_started":1}
I20260810 14:52:15.002444 15768 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:15.002573 15768 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:15.002777 15768 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
W20260810 14:52:15.003156 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:15.003242 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:15.003285 15030 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:15.003346 15768 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:15.009090 15769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:15.008897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:59383)
0810 14:52:15.009010 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:15.009046 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":55,"threads_started":1}
I20260810 14:52:15.074677 15770 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:15.074485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:50235)
0810 14:52:15.074598 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:15.074634 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260810 14:52:15.203677 15772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:15.203468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:53781)
0810 14:52:15.203603 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:15.203636 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260810 14:52:16.009692 15773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:16.009479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:60595)
0810 14:52:16.009606 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:16.009647 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":62,"threads_started":1}
I20260810 14:52:16.075299 15774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:16.075085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:50185)
0810 14:52:16.075214 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:16.075251 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":60,"threads_started":1}
I20260810 14:52:16.204360 15775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:16.204149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:38273)
0810 14:52:16.204273 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:16.204308 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88,"thread_start_us":62,"threads_started":1}
I20260810 14:52:16.795855 15778 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:16.795954 15778 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:16.796103 15778 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
W20260810 14:52:16.796481 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:16.796556 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:16.796612 15020 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:16.796679 15778 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:17.010322 15780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:17.010088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:34613)
0810 14:52:17.010211 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:17.010251 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
I20260810 14:52:17.075847 15781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:17.075658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:50983)
0810 14:52:17.075771 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:17.075805 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260810 14:52:17.205013 15784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:17.204798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:44363)
0810 14:52:17.204935 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:17.204968 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260810 14:52:18.010916 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:18.010702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:36587)
0810 14:52:18.010834 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:18.010871 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
I20260810 14:52:18.076480 15787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:18.076259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:50963)
0810 14:52:18.076395 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:18.076433 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":80,"threads_started":1}
I20260810 14:52:18.205720 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:18.205474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:56405)
0810 14:52:18.205637 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:18.205675 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":92,"threads_started":1}
I20260810 14:52:19.011622 15789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:19.011362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:56911)
0810 14:52:19.011528 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:19.011576 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":80,"threads_started":1}
I20260810 14:52:19.077184 15790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:19.076939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:44379)
0810 14:52:19.077091 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:19.077138 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
I20260810 14:52:19.206512 15792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:19.206240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:51349)
0810 14:52:19.206414 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:19.206462 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":84,"threads_started":1}
I20260810 14:52:20.012307 15794 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:20.012095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:54179)
0810 14:52:20.012224 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:20.012261 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260810 14:52:20.077829 15799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:20.077617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:52113)
0810 14:52:20.077747 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:20.077785 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":60,"threads_started":1}
I20260810 14:52:20.207223 15803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:20.206996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:37227)
0810 14:52:20.207134 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:20.207175 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260810 14:52:20.255815 15804 raft_consensus.cc:482] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:20.255927 15804 raft_consensus.cc:504] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "babe3da7e2004750bd409300dd67773b" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45243 } } peers { permanent_uuid: "60d0233f4d844b158a2e035b8b7265ba" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 38325 } } peers { permanent_uuid: "eac71b34b8974c09ae9346dcce1e1ac3" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 45401 } }
I20260810 14:52:20.256124 15804 leader_election.cc:288] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers babe3da7e2004750bd409300dd67773b (127.19.29.195:45243), 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325)
W20260810 14:52:20.256520 15020 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer babe3da7e2004750bd409300dd67773b (127.19.29.195:45243): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
W20260810 14:52:20.256597 15030 leader_election.cc:341] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 60d0233f4d844b158a2e035b8b7265ba (127.19.29.194:38325): Not found: Tablet not found: d8e964c9fc904d3e870d47d6d0845d0e
I20260810 14:52:20.256640 15030 leader_election.cc:302] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eac71b34b8974c09ae9346dcce1e1ac3; no voters: 60d0233f4d844b158a2e035b8b7265ba, babe3da7e2004750bd409300dd67773b
I20260810 14:52:20.256731 15804 raft_consensus.cc:2726] T d8e964c9fc904d3e870d47d6d0845d0e P eac71b34b8974c09ae9346dcce1e1ac3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260810 14:52:21.013023 15806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:21.012797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.193:53745)
0810 14:52:21.012937 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:21.012971 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260810 14:52:21.078577 15810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:21.078331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.194:52997)
0810 14:52:21.078483 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:21.078529 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":77,"threads_started":1}
I20260810 14:52:21.205866 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 14933
I20260810 14:52:21.212587 15811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:21.210911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36257 (local address 127.19.29.195:43061)
0810 14:52:21.212492 (+ 1581us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:21.212532 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.254:36257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1562,"thread_start_us":1486,"threads_started":1}
I20260810 14:52:21.223112 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 15244
I20260810 14:52:21.234211 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 15476
2026-08-10T14:52:21Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58585 ms)
[----------] 30 tests from SecurityITest (231103 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:21 dist-test-slave-4tdj krb5kdc[15814](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:21 dist-test-slave-4tdj krb5kdc[15814](info): set up 2 sockets
Aug 10 14:52:21 dist-test-slave-4tdj krb5kdc[15814](info): commencing operation
krb5kdc: starting...
W20260810 14:52:22.404462 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:22.517316 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38469
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:38469
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:22.597447 15835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:22.597652 15835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:22.597681 15835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:22.598814 15835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:22.598853 15835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:22.598871 15835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:22.598887 15835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:22.598903 15835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:22.600358 15835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:38469
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:38469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:22.600606 15835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:22.600809 15835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:22.605732 15848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:22.605772 15846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:22.605815 15835 server_base.cc:1034] running on GCE node
W20260810 14:52:22.605782 15854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:22.606118 15835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:22.606426 15835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:22.607570 15835 hybrid_clock.cc:648] HybridClock initialized: now 1786373542607550 us; error 32 us; skew 500 ppm
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:22.609902 15835 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:22.610430 15835 webserver.cc:460] Webserver started at http://127.19.29.254:39037/ using document root <none> and password file <none>
I20260810 14:52:22.610677 15835 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:22.610729 15835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:22.610865 15835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:22.611943 15835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "d5f12a43750641fda6a98e836c53da4b"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "967898c9144b5d1ff25d41f9826dda17"
server_key_iv: "2b577ae49cefeb9caa88e6e0712e2eba"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.612304 15835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "d5f12a43750641fda6a98e836c53da4b"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "967898c9144b5d1ff25d41f9826dda17"
server_key_iv: "2b577ae49cefeb9caa88e6e0712e2eba"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.614434 15835 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260810 14:52:22.615236 15873 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.615396 15835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:22.615515 15835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "d5f12a43750641fda6a98e836c53da4b"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "967898c9144b5d1ff25d41f9826dda17"
server_key_iv: "2b577ae49cefeb9caa88e6e0712e2eba"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.615586 15835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:22.626695 15835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:22.628302 15835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:22.628443 15835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:22.632575 15835 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:38469
I20260810 14:52:22.632606 15960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:38469 every 8 connection(s)
I20260810 14:52:22.632925 15835 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:22.633764 15962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:22.635954 15962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: Bootstrap starting.
I20260810 14:52:22.636540 15962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:22.636806 15962 log.cc:824] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:22.637476 15962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: No bootstrap required, opened a new log
I20260810 14:52:22.639106 15962 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } }
I20260810 14:52:22.639245 15962 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:22.639267 15962 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5f12a43750641fda6a98e836c53da4b, State: Initialized, Role: FOLLOWER
I20260810 14:52:22.639403 15962 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } }
I20260810 14:52:22.639464 15962 raft_consensus.cc:388] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:22.639489 15962 raft_consensus.cc:482] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:22.639534 15962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:22.640038 15962 raft_consensus.cc:504] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } }
I20260810 14:52:22.640125 15962 leader_election.cc:302] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d5f12a43750641fda6a98e836c53da4b; no voters:
I20260810 14:52:22.640268 15962 leader_election.cc:288] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:22.640317 15967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:22.640480 15967 raft_consensus.cc:686] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [term 1 LEADER]: Becoming Leader. State: Replica: d5f12a43750641fda6a98e836c53da4b, State: Running, Role: LEADER
I20260810 14:52:22.640516 15962 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:22.640628 15967 consensus_queue.cc:237] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } }
I20260810 14:52:22.641156 15970 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d5f12a43750641fda6a98e836c53da4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } } }
I20260810 14:52:22.641371 15970 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:22.641304 15971 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d5f12a43750641fda6a98e836c53da4b. Latest consensus state: current_term: 1 leader_uuid: "d5f12a43750641fda6a98e836c53da4b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d5f12a43750641fda6a98e836c53da4b" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 38469 } } }
I20260810 14:52:22.641561 15971 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:22.641757 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 15835
I20260810 14:52:22.641805 15982 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:22.641875 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:22.642061 19575 external_mini_cluster.cc:1428] Setting key bc52b2e33e617735d8776bd3a847f03d
I20260810 14:52:22.642383 15982 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:22.643988 15982 catalog_manager.cc:1347] Generated new cluster ID: c5e4b8b4eac249709ed682847354a9da
I20260810 14:52:22.644032 15982 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:22.658586 15982 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:22.659250 15982 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:22.660115 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:22.642558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34096 (local address 127.19.29.254:38469)
0810 14:52:22.642724 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:22.642732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:22.642973 (+ 241us) server_negotiation.cc:407] Connection header received
0810 14:52:22.643090 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:22.643097 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:22.643159 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:22.643275 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:22.650376 (+ 7101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.651772 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.652882 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.653487 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.653573 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:22.656384 (+ 2811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:22.656389 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:22.656390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:22.656404 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:22.658431 (+ 2027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.658842 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.658846 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.658846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.658943 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.659120 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.659121 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.659121 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.659354 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:22.659516 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:22.659744 (+ 228us) server_negotiation.cc:299] Negotiation successful
0810 14:52:22.659895 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":71,"threads_started":1}
I20260810 14:52:22.661840 15982 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: Generated new TSK 0
I20260810 14:52:22.661998 15982 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:52:22.690342 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:22.770725 16000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:22.770915 16000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:22.770938 16000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:22.772050 16000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:22.772090 16000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:22.772115 16000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:22.773537 16000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:22.773751 16000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:22.773959 16000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:22.778785 16006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:22.778756 16013 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:22.778761 16009 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:22.778788 16000 server_base.cc:1034] running on GCE node
I20260810 14:52:22.779165 16000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:22.779385 16000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:22.780547 16000 hybrid_clock.cc:648] HybridClock initialized: now 1786373542780534 us; error 31 us; skew 500 ppm
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:22.782934 16000 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:52:22.783324 16000 webserver.cc:460] Webserver started at http://127.19.29.193:32945/ using document root <none> and password file <none>
I20260810 14:52:22.783516 16000 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:22.783563 16000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:22.783685 16000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:22.784672 16000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "75da3b34337f4171a05538fc3972630c"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "2d7f7f6345ddc0d3ce7b81d7cbefe6f9"
server_key_iv: "e9bf1f196c0618bbde0ff88c6162a677"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.784988 16000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "75da3b34337f4171a05538fc3972630c"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "2d7f7f6345ddc0d3ce7b81d7cbefe6f9"
server_key_iv: "e9bf1f196c0618bbde0ff88c6162a677"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.786230 16000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:52:22.786945 16026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.787092 16000 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:22.787174 16000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "75da3b34337f4171a05538fc3972630c"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "2d7f7f6345ddc0d3ce7b81d7cbefe6f9"
server_key_iv: "e9bf1f196c0618bbde0ff88c6162a677"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.787233 16000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:22.810762 16000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:22.812541 16000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:22.812670 16000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:22.812873 16000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:22.813156 16000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:22.813189 16000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.813216 16000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:22.813233 16000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.818701 16000 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:39855
I20260810 14:52:22.818775 16210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:39855 every 8 connection(s)
I20260810 14:52:22.819023 16000 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:22.825238 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 16000
I20260810 14:52:22.825346 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:22.825536 19575 external_mini_cluster.cc:1428] Setting key 075555496ff7eaf9e451abfde1c5ccd3
I20260810 14:52:22.827527 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:22.819699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:56611 (local address 127.19.29.254:38469)
0810 14:52:22.819776 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:22.819779 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:22.819914 (+ 135us) server_negotiation.cc:407] Connection header received
0810 14:52:22.820394 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:22.820395 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:22.820405 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:22.820454 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:22.821318 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.821805 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.822718 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.822919 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.822970 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:22.824883 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:22.824885 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:22.824885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:22.824892 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:22.826310 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.826702 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.826703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.826703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.826752 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.826983 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.826983 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.826983 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.827077 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:22.827121 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:22.827393 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 14:52:22.827460 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260810 14:52:22.827791 16215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:22.819663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38469 (local address 127.19.29.193:56611)
0810 14:52:22.819804 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:22.819839 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:22.820302 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:22.820508 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:22.820511 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:22.821060 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:22.821250 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:22.821255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.821864 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.821865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:22.822648 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:22.822651 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.822978 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.822978 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:22.823105 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:22.823545 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:22.823553 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:22.824798 (+ 1245us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:22.826375 (+ 1577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:22.826383 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:22.826386 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:22.826638 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:22.826804 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:22.826805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:22.826805 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:22.826932 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:22.827126 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:22.827131 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:22.827275 (+ 144us) client_negotiation.cc:769] Sending connection context
0810 14:52:22.827381 (+ 106us) client_negotiation.cc:240] Negotiation successful
0810 14:52:22.827529 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":77,"threads_started":1}
I20260810 14:52:22.828480 16211 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38469
I20260810 14:52:22.828568 16211 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:22.828735 16211 heartbeater.cc:511] Master 127.19.29.254:38469 requested a full tablet report, sending...
I20260810 14:52:22.829205 15896 ts_manager.cc:194] Registered new tserver with Master: 75da3b34337f4171a05538fc3972630c (127.19.29.193:39855)
I20260810 14:52:22.829792 15896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:56611
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:52:22.850533 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:22.931696 16219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:22.931885 16219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:22.931907 16219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:22.933015 16219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:22.933064 16219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:22.933089 16219 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:22.934530 16219 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:22.934746 16219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:22.934947 16219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:22.939711 16229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:22.939824 16219 server_base.cc:1034] running on GCE node
W20260810 14:52:22.939720 16225 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:22.939921 16231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:22.940157 16219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:22.940385 16219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:22.941618 16219 hybrid_clock.cc:648] HybridClock initialized: now 1786373542941599 us; error 28 us; skew 500 ppm
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:22.944090 16219 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:52:22.944501 16219 webserver.cc:460] Webserver started at http://127.19.29.194:37459/ using document root <none> and password file <none>
I20260810 14:52:22.944710 16219 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:22.944751 16219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:22.944840 16219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:22.945789 16219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "47b4004b40ba4c8a92694aabc18e3079"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "894a924aaa74bccb8a5e079228eabf1b"
server_key_iv: "c6cdb3e39ea083cee3b13253c3ac17ca"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.946069 16219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "47b4004b40ba4c8a92694aabc18e3079"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "894a924aaa74bccb8a5e079228eabf1b"
server_key_iv: "c6cdb3e39ea083cee3b13253c3ac17ca"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.947288 16219 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:22.948007 16244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.948201 16219 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:22.948292 16219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "47b4004b40ba4c8a92694aabc18e3079"
format_stamp: "Formatted at 2026-08-10 14:52:22 on dist-test-slave-4tdj"
server_key: "894a924aaa74bccb8a5e079228eabf1b"
server_key_iv: "c6cdb3e39ea083cee3b13253c3ac17ca"
server_key_version: "encryptionkey@0"
I20260810 14:52:22.948354 16219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:22.960412 16219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:22.961967 16219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:22.962093 16219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:22.962280 16219 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:22.962623 16219 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:22.962657 16219 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.962683 16219 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:22.962710 16219 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:22.968338 16219 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:35911
I20260810 14:52:22.968743 16219 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:22.968776 16426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:35911 every 8 connection(s)
Aug 10 14:52:22 dist-test-slave-4tdj krb5kdc[15814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373542, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:22.976547 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 16219
I20260810 14:52:22.976650 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:22.976850 19575 external_mini_cluster.cc:1428] Setting key a360b860805e96e1a0742db802c09531
I20260810 14:52:22.979803 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:22.970456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:49681 (local address 127.19.29.254:38469)
0810 14:52:22.970508 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:22.970510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:22.970659 (+ 149us) server_negotiation.cc:407] Connection header received
0810 14:52:22.971167 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:22.971169 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:22.971184 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:22.971260 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:22.972443 (+ 1183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.973204 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.974539 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.974749 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.974799 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:22.976853 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:22.976855 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:22.976855 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:22.976863 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:22.978413 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.978783 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.978785 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.978785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.978843 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:22.979081 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:22.979082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:22.979082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:22.979234 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:22.979297 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:22.979627 (+ 330us) server_negotiation.cc:299] Negotiation successful
0810 14:52:22.979713 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:52:22.979933 16429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:22.969386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38469 (local address 127.19.29.194:49681)
0810 14:52:22.970514 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:22.970560 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:22.971068 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:22.971349 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:22.971353 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:22.972085 (+ 732us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:22.972343 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:22.972350 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.973298 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.973299 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:22.974463 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:22.974467 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:22.974824 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:22.974825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:22.974948 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:22.975379 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:22.975389 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:22.976759 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:22.978498 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:22.978505 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:22.978507 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:22.978714 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:22.978897 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:22.978897 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:22.978898 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:22.979019 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:22.979327 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:22.979335 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:22.979482 (+ 147us) client_negotiation.cc:769] Sending connection context
0810 14:52:22.979584 (+ 102us) client_negotiation.cc:240] Negotiation successful
0810 14:52:22.979734 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"thread_start_us":1032,"threads_started":1}
I20260810 14:52:22.980400 16427 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38469
I20260810 14:52:22.980541 16427 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:22.980763 16427 heartbeater.cc:511] Master 127.19.29.254:38469 requested a full tablet report, sending...
I20260810 14:52:22.981248 15896 ts_manager.cc:194] Registered new tserver with Master: 47b4004b40ba4c8a92694aabc18e3079 (127.19.29.194:35911)
I20260810 14:52:22.981731 15896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:49681
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:52:23.008730 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:38623
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:23.096423 16439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:23.096654 16439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:23.096692 16439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:23.097819 16439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:23.097867 16439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:23.097903 16439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:23.099392 16439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:38623
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:38469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:23.099646 16439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:23.099874 16439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:23.104945 16447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.105043 16446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.105137 16454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:23.105149 16439 server_base.cc:1034] running on GCE node
I20260810 14:52:23.105417 16439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:23.105666 16439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:23.106817 16439 hybrid_clock.cc:648] HybridClock initialized: now 1786373543106800 us; error 32 us; skew 500 ppm
Aug 10 14:52:23 dist-test-slave-4tdj krb5kdc[15814](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373543, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:23.109406 16439 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:52:23.109845 16439 webserver.cc:460] Webserver started at http://127.19.29.195:34981/ using document root <none> and password file <none>
I20260810 14:52:23.110059 16439 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:23.110105 16439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:23.110234 16439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:23.111326 16439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "bec38a2d039a4e3da3ae3d239f912fbb"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "224a08e5a82d6c846acb85d3743bb9c8"
server_key_iv: "800850dfa7ff9fcfb91fa88f9af2229d"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.111660 16439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "bec38a2d039a4e3da3ae3d239f912fbb"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "224a08e5a82d6c846acb85d3743bb9c8"
server_key_iv: "800850dfa7ff9fcfb91fa88f9af2229d"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.112942 16439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:23.113689 16466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.113868 16439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:23.113951 16439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "bec38a2d039a4e3da3ae3d239f912fbb"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "224a08e5a82d6c846acb85d3743bb9c8"
server_key_iv: "800850dfa7ff9fcfb91fa88f9af2229d"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.114015 16439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:23.124922 16439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:23.126904 16439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:23.127031 16439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:23.127223 16439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:23.127499 16439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:23.127532 16439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.127558 16439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:23.127580 16439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.132987 16439 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:43567
I20260810 14:52:23.133028 16650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:43567 every 8 connection(s)
I20260810 14:52:23.133337 16439 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:23.134722 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 16439
I20260810 14:52:23.134810 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:23.134996 19575 external_mini_cluster.cc:1428] Setting key 086022cf820746ae40e1aff95e1193e2
Aug 10 14:52:23 dist-test-slave-4tdj krb5kdc[15814](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373543, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:23.142365 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.133985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:58155 (local address 127.19.29.254:38469)
0810 14:52:23.134047 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.134049 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.134239 (+ 190us) server_negotiation.cc:407] Connection header received
0810 14:52:23.134777 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.134778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.134791 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.134838 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.135854 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.136517 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.137502 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.137685 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.137730 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.139630 (+ 1900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.139631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.139632 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:23.139639 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.140957 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:23.141407 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:23.141407 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:23.141408 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:23.141457 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:23.141686 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:23.141688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:23.141688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:23.141859 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.141920 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.142172 (+ 252us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.142258 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260810 14:52:23.142517 16653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.133942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:38469 (local address 127.19.29.195:58155)
0810 14:52:23.134114 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.134157 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.134676 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.134906 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.134910 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.135561 (+ 651us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:23.135766 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.135773 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.136596 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.136597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.137442 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.137445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.137740 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.137741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.137841 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.138226 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:23.138234 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:23.139552 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:23.141052 (+ 1500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:23.141059 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:23.141060 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:23.141339 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:23.141506 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:23.141506 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:23.141507 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:23.141618 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:23.141919 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:23.141927 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:23.142049 (+ 122us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.142138 (+ 89us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.142282 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":85,"threads_started":1}
I20260810 14:52:23.143033 16651 heartbeater.cc:347] Connected to a master server at 127.19.29.254:38469
I20260810 14:52:23.143114 16651 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:23.143280 16651 heartbeater.cc:511] Master 127.19.29.254:38469 requested a full tablet report, sending...
I20260810 14:52:23.143625 15896 ts_manager.cc:194] Registered new tserver with Master: bec38a2d039a4e3da3ae3d239f912fbb (127.19.29.195:43567)
I20260810 14:52:23.143955 15896 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:58155
I20260810 14:52:23.146715 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:23.153566 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.148003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34108 (local address 127.19.29.254:38469)
0810 14:52:23.148061 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.148063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.148171 (+ 108us) server_negotiation.cc:407] Connection header received
0810 14:52:23.148210 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.148211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.148219 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.148261 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.148788 (+ 527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.149245 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.149916 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.150100 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.150150 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.151361 (+ 1211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.151363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.151363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:23.151369 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.152650 (+ 1281us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:23.152971 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:23.152972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:23.152972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:23.153015 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:23.153141 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:23.153142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:23.153142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:23.153265 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.153340 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.153432 (+ 92us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.153486 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 14:52:23.155015 15896 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:23.156564 15896 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:23.163601 16667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.158881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:39855 (local address 127.0.0.1:58130)
0810 14:52:23.159153 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.159196 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.159271 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.159515 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.159517 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.159519 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.159576 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.159577 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.160898 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.160899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.162239 (+ 1340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.162243 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163289 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163291 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.163395 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163398 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.163448 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.163526 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"mutex_wait_us":4,"thread_start_us":65,"threads_started":1}
I20260810 14:52:23.163614 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.159123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.19.29.195:43567)
0810 14:52:23.159938 (+ 815us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.159943 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.159952 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:23.159986 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.159988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.160002 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.160072 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.160165 (+ 93us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.160965 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.162396 (+ 1431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163145 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163201 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163252 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.163498 (+ 246us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.163540 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":780,"thread_start_us":99,"threads_started":1}
I20260810 14:52:23.163655 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.159159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51122 (local address 127.19.29.194:35911)
0810 14:52:23.159662 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.159666 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.159674 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:23.159712 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.159714 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.159729 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.159806 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.160158 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.161199 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.162590 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163108 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163178 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163239 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.163503 (+ 264us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.163568 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":67,"threads_started":1}
I20260810 14:52:23.163846 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.159021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58130 (local address 127.19.29.193:39855)
0810 14:52:23.159355 (+ 334us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.159360 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.159370 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:23.159404 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.159406 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.159418 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.159495 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.159670 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.160771 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.162378 (+ 1607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163122 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163195 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163252 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.163714 (+ 462us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.163772 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":88,"threads_started":1}
I20260810 14:52:23.164278 16666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.158890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:35911 (local address 127.0.0.1:51122)
0810 14:52:23.159192 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.159201 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.159271 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.159802 (+ 531us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.159803 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.159805 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.159909 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.159911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.161325 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.161326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.162505 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.162508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163280 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.163371 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163386 (+ 15us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.163453 (+ 67us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.164207 (+ 754us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"mutex_wait_us":706,"thread_start_us":73,"threads_started":1}
I20260810 14:52:23.164568 16665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.158892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43567 (local address 127.0.0.1:40542)
0810 14:52:23.159370 (+ 478us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.159379 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.159416 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.160077 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.160078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.160080 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.160115 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.160116 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.161081 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.161083 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.162098 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.162101 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.163291 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.163292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.163381 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.163389 (+ 8us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.163448 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.164507 (+ 1059us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"mutex_wait_us":746,"thread_start_us":52,"threads_started":1}
I20260810 14:52:23.164947 16117 tablet_service.cc:1467] Processing CreateTablet for tablet f8f08607454e41f69417708a2eba033f (DEFAULT_TABLE table=test-table [id=ab564d79b96e400c95f9cf4e8f3bb951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.165040 16321 tablet_service.cc:1467] Processing CreateTablet for tablet f8f08607454e41f69417708a2eba033f (DEFAULT_TABLE table=test-table [id=ab564d79b96e400c95f9cf4e8f3bb951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.165375 16117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f08607454e41f69417708a2eba033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.165386 16321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f08607454e41f69417708a2eba033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.165333 16546 tablet_service.cc:1467] Processing CreateTablet for tablet f8f08607454e41f69417708a2eba033f (DEFAULT_TABLE table=test-table [id=ab564d79b96e400c95f9cf4e8f3bb951]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.165652 16546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f8f08607454e41f69417708a2eba033f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.168038 16673 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Bootstrap starting.
I20260810 14:52:23.168629 16673 tablet_bootstrap.cc:654] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.168762 16678 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Bootstrap starting.
I20260810 14:52:23.169212 16673 log.cc:824] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.169437 16678 tablet_bootstrap.cc:654] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.169996 16673 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: No bootstrap required, opened a new log
I20260810 14:52:23.170004 16678 log.cc:824] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.170074 16673 ts_tablet_manager.cc:1397] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:23.170369 16677 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: Bootstrap starting.
I20260810 14:52:23.170794 16678 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: No bootstrap required, opened a new log
I20260810 14:52:23.170874 16678 ts_tablet_manager.cc:1397] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:23.172204 16673 raft_consensus.cc:348] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.172390 16673 raft_consensus.cc:374] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.172427 16673 raft_consensus.cc:729] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b4004b40ba4c8a92694aabc18e3079, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.172583 16673 consensus_queue.cc:260] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.172894 16673 ts_tablet_manager.cc:1428] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:52:23.172932 16427 heartbeater.cc:503] Master 127.19.29.254:38469 was elected leader, sending a full tablet report...
I20260810 14:52:23.172842 16678 raft_consensus.cc:348] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.172997 16678 raft_consensus.cc:374] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.173048 16678 raft_consensus.cc:729] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bec38a2d039a4e3da3ae3d239f912fbb, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.173143 16678 consensus_queue.cc:260] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.173419 16678 ts_tablet_manager.cc:1428] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:52:23.173455 16651 heartbeater.cc:503] Master 127.19.29.254:38469 was elected leader, sending a full tablet report...
I20260810 14:52:23.174081 16677 tablet_bootstrap.cc:654] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.174650 16677 log.cc:824] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.175295 16677 tablet_bootstrap.cc:492] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: No bootstrap required, opened a new log
I20260810 14:52:23.175356 16677 ts_tablet_manager.cc:1397] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260810 14:52:23.177038 16677 raft_consensus.cc:348] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.177179 16677 raft_consensus.cc:374] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.177224 16677 raft_consensus.cc:729] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75da3b34337f4171a05538fc3972630c, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.177336 16677 consensus_queue.cc:260] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.177603 16677 ts_tablet_manager.cc:1428] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:23.177685 16211 heartbeater.cc:503] Master 127.19.29.254:38469 was elected leader, sending a full tablet report...
W20260810 14:52:23.219560 16428 tablet.cc:2369] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:23.241894 16681 raft_consensus.cc:482] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:23.242058 16681 raft_consensus.cc:504] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.242466 16681 leader_election.cc:288] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75da3b34337f4171a05538fc3972630c (127.19.29.193:39855), bec38a2d039a4e3da3ae3d239f912fbb (127.19.29.195:43567)
I20260810 14:52:23.246269 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.242724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:40349 (local address 127.19.29.193:39855)
0810 14:52:23.242792 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.242793 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.242803 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:23.242833 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.242834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.242843 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.242910 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.243084 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.243846 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245342 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.245919 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245995 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.246004 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.246159 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.246199 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 14:52:23.246269 16670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.242727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:57657 (local address 127.19.29.195:43567)
0810 14:52:23.242792 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.242794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.242886 (+ 92us) server_negotiation.cc:407] Connection header received
0810 14:52:23.242936 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.242937 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.242946 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.242992 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.243123 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.243848 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245341 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.245919 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245994 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.246004 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.246159 (+ 155us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.246199 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:52:23.246345 16429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.242634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:39855 (local address 127.19.29.194:40349)
0810 14:52:23.242691 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.242702 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.242744 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.242923 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.242924 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.242926 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.243000 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.243001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.243930 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.243930 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.245257 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.245261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.245998 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.246096 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.246098 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.246147 (+ 49us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.246194 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":59}
I20260810 14:52:23.246351 16685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.242635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:43567 (local address 127.19.29.194:57657)
0810 14:52:23.242824 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.242831 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.242876 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.243005 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.243006 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.243007 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.243064 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.243065 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.243929 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.243930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.245257 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.245261 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.245999 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.245999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.246087 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.246092 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.246147 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.246194 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"mutex_wait_us":88,"thread_start_us":128,"threads_started":1}
I20260810 14:52:23.246762 16142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f08607454e41f69417708a2eba033f" candidate_uuid: "47b4004b40ba4c8a92694aabc18e3079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75da3b34337f4171a05538fc3972630c" is_pre_election: true
I20260810 14:52:23.246757 16578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f08607454e41f69417708a2eba033f" candidate_uuid: "47b4004b40ba4c8a92694aabc18e3079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" is_pre_election: true
I20260810 14:52:23.246912 16578 raft_consensus.cc:2454] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b4004b40ba4c8a92694aabc18e3079 in term 0.
I20260810 14:52:23.246912 16142 raft_consensus.cc:2454] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b4004b40ba4c8a92694aabc18e3079 in term 0.
I20260810 14:52:23.247117 16248 leader_election.cc:302] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b4004b40ba4c8a92694aabc18e3079, bec38a2d039a4e3da3ae3d239f912fbb; no voters:
I20260810 14:52:23.247295 16681 raft_consensus.cc:2781] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:23.247351 16681 raft_consensus.cc:482] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:23.247367 16681 raft_consensus.cc:3037] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:23.248060 16681 raft_consensus.cc:504] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.248181 16681 leader_election.cc:288] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [CANDIDATE]: Term 1 election: Requested vote from peers 75da3b34337f4171a05538fc3972630c (127.19.29.193:39855), bec38a2d039a4e3da3ae3d239f912fbb (127.19.29.195:43567)
I20260810 14:52:23.248324 16142 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f08607454e41f69417708a2eba033f" candidate_uuid: "47b4004b40ba4c8a92694aabc18e3079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75da3b34337f4171a05538fc3972630c"
I20260810 14:52:23.248329 16578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8f08607454e41f69417708a2eba033f" candidate_uuid: "47b4004b40ba4c8a92694aabc18e3079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bec38a2d039a4e3da3ae3d239f912fbb"
I20260810 14:52:23.248394 16142 raft_consensus.cc:3037] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:23.248407 16578 raft_consensus.cc:3037] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:23.249081 16142 raft_consensus.cc:2454] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b4004b40ba4c8a92694aabc18e3079 in term 1.
I20260810 14:52:23.249181 16578 raft_consensus.cc:2454] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b4004b40ba4c8a92694aabc18e3079 in term 1.
I20260810 14:52:23.249264 16245 leader_election.cc:302] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b4004b40ba4c8a92694aabc18e3079, 75da3b34337f4171a05538fc3972630c; no voters:
I20260810 14:52:23.249361 16681 raft_consensus.cc:2781] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:23.249507 16681 raft_consensus.cc:686] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 1 LEADER]: Becoming Leader. State: Replica: 47b4004b40ba4c8a92694aabc18e3079, State: Running, Role: LEADER
I20260810 14:52:23.249593 16681 consensus_queue.cc:237] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } }
I20260810 14:52:23.250401 15896 catalog_manager.cc:5495] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47b4004b40ba4c8a92694aabc18e3079 (127.19.29.194). New cstate: current_term: 1 leader_uuid: "47b4004b40ba4c8a92694aabc18e3079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47b4004b40ba4c8a92694aabc18e3079" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 35911 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 } health_report { overall_health: UNKNOWN } } }
I20260810 14:52:23.255836 16671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.253707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51132 (local address 127.19.29.194:35911)
0810 14:52:23.253765 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.253767 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.253776 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:23.253805 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.253806 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.253824 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.253880 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:23.254001 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.254488 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.255170 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.255351 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.255402 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.255533 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:23.255631 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:23.255699 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.255735 (+ 36us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.255755 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260810 14:52:23.257345 16578 raft_consensus.cc:1261] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 1 FOLLOWER]: Refusing update from remote peer 47b4004b40ba4c8a92694aabc18e3079: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:23.257360 16142 raft_consensus.cc:1261] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 1 FOLLOWER]: Refusing update from remote peer 47b4004b40ba4c8a92694aabc18e3079: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:23.257643 16686 consensus_queue.cc:1035] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bec38a2d039a4e3da3ae3d239f912fbb" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 43567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:23.257762 16681 consensus_queue.cc:1035] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75da3b34337f4171a05538fc3972630c" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 39855 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:23.260136 16690 mvcc.cc:205] Tried to move back new op lower bound from 7316986033179693056 to 7316986033150902272. Current Snapshot: MvccSnapshot[applied={T|T < 7316986033179693056}]
I20260810 14:52:23.260382 16692 mvcc.cc:205] Tried to move back new op lower bound from 7316986033179693056 to 7316986033150902272. Current Snapshot: MvccSnapshot[applied={T|T < 7316986033179693056}]
I20260810 14:52:23.261255 16691 mvcc.cc:205] Tried to move back new op lower bound from 7316986033179693056 to 7316986033150902272. Current Snapshot: MvccSnapshot[applied={T|T < 7316986033179693056 or (T in {7316986033179693056})}]
I20260810 14:52:23.262389 15894 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:23.262477 15894 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:23.263171 15894 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d5f12a43750641fda6a98e836c53da4b: Sending DeleteTablet for 3 replicas of tablet f8f08607454e41f69417708a2eba033f
I20260810 14:52:23.263494 16321 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f08607454e41f69417708a2eba033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:23 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:51122
I20260810 14:52:23.263509 16546 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f08607454e41f69417708a2eba033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:23 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40542
I20260810 14:52:23.263715 16117 tablet_service.cc:1514] Processing DeleteTablet for tablet f8f08607454e41f69417708a2eba033f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:23 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:58130
I20260810 14:52:23.263921 16704 tablet_replica.cc:330] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c: stopping tablet replica
I20260810 14:52:23.264027 16704 raft_consensus.cc:2229] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:23.264062 16701 tablet_replica.cc:330] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: stopping tablet replica
I20260810 14:52:23.264138 16704 raft_consensus.cc:2258] T f8f08607454e41f69417708a2eba033f P 75da3b34337f4171a05538fc3972630c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:23.264155 16701 raft_consensus.cc:2229] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:52:23.264235 16701 raft_consensus.cc:2258] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:23.264485 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 16000
I20260810 14:52:23.264767 16701 ts_tablet_manager.cc:1905] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:23.266168 16703 tablet_replica.cc:330] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: stopping tablet replica
I20260810 14:52:23.266278 16703 raft_consensus.cc:2229] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:23.266382 16703 raft_consensus.cc:2258] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:23.266508 16701 ts_tablet_manager.cc:1918] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:23.266561 16701 log.cc:1196] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/f8f08607454e41f69417708a2eba033f
I20260810 14:52:23.266785 16701 ts_tablet_manager.cc:1939] T f8f08607454e41f69417708a2eba033f P 47b4004b40ba4c8a92694aabc18e3079: Deleting consensus metadata
I20260810 14:52:23.271302 15876 catalog_manager.cc:4841] TS 47b4004b40ba4c8a92694aabc18e3079 (127.19.29.194:35911): tablet f8f08607454e41f69417708a2eba033f (table test-table [id=ab564d79b96e400c95f9cf4e8f3bb951]) successfully deleted
I20260810 14:52:23.290670 16703 ts_tablet_manager.cc:1905] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:23.292455 16703 ts_tablet_manager.cc:1918] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:23.292541 16703 log.cc:1196] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/f8f08607454e41f69417708a2eba033f
I20260810 14:52:23.292810 16703 ts_tablet_manager.cc:1939] T f8f08607454e41f69417708a2eba033f P bec38a2d039a4e3da3ae3d239f912fbb: Deleting consensus metadata
W20260810 14:52:23.292827 15874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:39855 (error 108)
I20260810 14:52:23.293263 15878 catalog_manager.cc:4841] TS bec38a2d039a4e3da3ae3d239f912fbb (127.19.29.195:43567): tablet f8f08607454e41f69417708a2eba033f (table test-table [id=ab564d79b96e400c95f9cf4e8f3bb951]) successfully deleted
I20260810 14:52:23.293339 16665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.293177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:39855 (local address 127.0.0.1:58142)
0810 14:52:23.293219 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.293255 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:39855: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260810 14:52:23.293527 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 16219
W20260810 14:52:23.293509 15874 catalog_manager.cc:4584] TS 75da3b34337f4171a05538fc3972630c (127.19.29.193:39855): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f8f08607454e41f69417708a2eba033f: Network error: Client connection negotiation failed: client connection to 127.19.29.193:39855: connect: Connection refused (error 111)
I20260810 14:52:23.320613 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 16439
I20260810 14:52:23.329945 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 15835
2026-08-10T14:52:23Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2100 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-10T14:52:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:23Z Disabled control of system clock
I20260810 14:52:23.366441 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36307
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:45285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36307
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:23.445279 16713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:23.445477 16713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:23.445495 16713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:23.446571 16713 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:23.446602 16713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:23.446614 16713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:23.446624 16713 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:23.446635 16713 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:23.447872 16713 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36307
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36307
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:23.448051 16713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:23.448279 16713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:23.452771 16721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.452811 16722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.452802 16726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:23.452826 16713 server_base.cc:1034] running on GCE node
I20260810 14:52:23.453266 16713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:23.453521 16713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:23.454651 16713 hybrid_clock.cc:648] HybridClock initialized: now 1786373543454641 us; error 32 us; skew 500 ppm
I20260810 14:52:23.455787 16713 webserver.cc:460] Webserver started at http://127.19.29.254:36627/ using document root <none> and password file <none>
I20260810 14:52:23.455983 16713 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:23.456030 16713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:23.456162 16713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:23.457136 16713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "be77fb78de1240438eeac346a1297300"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "ba3ec520d741540fd9caaf8ccdcd0ba6"
server_key_iv: "92799eaf7da99bb11f320f2dbb019d80"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.457451 16713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "be77fb78de1240438eeac346a1297300"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "ba3ec520d741540fd9caaf8ccdcd0ba6"
server_key_iv: "92799eaf7da99bb11f320f2dbb019d80"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.458671 16713 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:23.459283 16741 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.459466 16713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:23.459553 16713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "be77fb78de1240438eeac346a1297300"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "ba3ec520d741540fd9caaf8ccdcd0ba6"
server_key_iv: "92799eaf7da99bb11f320f2dbb019d80"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.459616 16713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:23.480289 16713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:23.480584 16713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:23.480721 16713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:23.484491 16713 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36307
I20260810 14:52:23.484546 16822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36307 every 8 connection(s)
I20260810 14:52:23.484853 16713 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:23.485783 16823 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.488094 16823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: Bootstrap starting.
I20260810 14:52:23.488646 16823 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.488925 16823 log.cc:824] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.489550 16823 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: No bootstrap required, opened a new log
I20260810 14:52:23.490710 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 16713
I20260810 14:52:23.490808 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:23.490989 19575 external_mini_cluster.cc:1428] Setting key 9014ef0afd6b7e25f3e085a6e7e7218c
I20260810 14:52:23.491397 16823 raft_consensus.cc:348] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } }
I20260810 14:52:23.491573 16823 raft_consensus.cc:374] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.491623 16823 raft_consensus.cc:729] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: be77fb78de1240438eeac346a1297300, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.491740 16823 consensus_queue.cc:260] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } }
I20260810 14:52:23.491820 16823 raft_consensus.cc:388] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:23.491850 16823 raft_consensus.cc:482] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:23.491896 16823 raft_consensus.cc:3037] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:23.492489 16823 raft_consensus.cc:504] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } }
I20260810 14:52:23.492588 16823 leader_election.cc:302] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: be77fb78de1240438eeac346a1297300; no voters:
I20260810 14:52:23.492734 16823 leader_election.cc:288] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:23.492785 16829 raft_consensus.cc:2781] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:23.492925 16829 raft_consensus.cc:686] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [term 1 LEADER]: Becoming Leader. State: Replica: be77fb78de1240438eeac346a1297300, State: Running, Role: LEADER
I20260810 14:52:23.492970 16823 sys_catalog.cc:564] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:23.493026 16829 consensus_queue.cc:237] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } }
I20260810 14:52:23.493361 16829 sys_catalog.cc:455] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [sys.catalog]: SysCatalogTable state changed. Reason: New leader be77fb78de1240438eeac346a1297300. Latest consensus state: current_term: 1 leader_uuid: "be77fb78de1240438eeac346a1297300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } } }
I20260810 14:52:23.493423 16829 sys_catalog.cc:458] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:23.493430 16832 sys_catalog.cc:455] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "be77fb78de1240438eeac346a1297300" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "be77fb78de1240438eeac346a1297300" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36307 } } }
I20260810 14:52:23.493544 16832 sys_catalog.cc:458] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:23.493973 16838 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:23.494503 16838 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:23.495905 16838 catalog_manager.cc:1347] Generated new cluster ID: e33b52ad4d9e4ee4bbaf34320e1209e6
I20260810 14:52:23.495951 16838 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:23.497030 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.491495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40792 (local address 127.19.29.254:36307)
0810 14:52:23.491763 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.491770 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.491794 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:52:23.491896 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.491903 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.491970 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.492085 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.492277 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.493818 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.494857 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.495436 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.495566 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.496366 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.496371 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.496371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:23.496552 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.496591 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:23.496613 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.496670 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.496763 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.496836 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":191,"thread_start_us":78,"threads_started":1}
I20260810 14:52:23.510228 16838 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:23.510725 16838 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:23.521627 16838 catalog_manager.cc:5868] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: Generated new TSK 0
I20260810 14:52:23.521795 16838 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:23.529423 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--builtin_ntp_servers=127.19.29.212:45285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:23.609442 16856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:23.609632 16856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:23.609652 16856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:23.610796 16856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:23.610831 16856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:23.610854 16856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:23.612165 16856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:23.612385 16856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:23.612655 16856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:23.617411 16870 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.617448 16868 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.617468 16873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:23.617534 16856 server_base.cc:1034] running on GCE node
I20260810 14:52:23.617775 16856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:23.617983 16856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:23.619118 16856 hybrid_clock.cc:648] HybridClock initialized: now 1786373543619103 us; error 27 us; skew 500 ppm
I20260810 14:52:23.620285 16856 webserver.cc:460] Webserver started at http://127.19.29.193:38365/ using document root <none> and password file <none>
I20260810 14:52:23.620532 16856 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:23.620584 16856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:23.620708 16856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:23.621707 16856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "bacb067c30c94780993d6bd47e6fd2a8"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "151bc89125fc45b100943baa70bc603a"
server_key_iv: "dc7e794037b74d7b0869035d841b8aaa"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.622030 16856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "bacb067c30c94780993d6bd47e6fd2a8"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "151bc89125fc45b100943baa70bc603a"
server_key_iv: "dc7e794037b74d7b0869035d841b8aaa"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.623256 16856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:23.623895 16888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.624043 16856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:23.624127 16856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "bacb067c30c94780993d6bd47e6fd2a8"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "151bc89125fc45b100943baa70bc603a"
server_key_iv: "dc7e794037b74d7b0869035d841b8aaa"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.624186 16856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:23.638834 16856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:23.639106 16856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:23.639226 16856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:23.639418 16856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:23.639730 16856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:23.639765 16856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.639793 16856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:23.639816 16856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.645242 16856 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:34045
I20260810 14:52:23.645303 17076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:34045 every 8 connection(s)
I20260810 14:52:23.645589 16856 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:52:23.650122 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.646223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48481 (local address 127.19.29.254:36307)
0810 14:52:23.646270 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.646272 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.646494 (+ 222us) server_negotiation.cc:407] Connection header received
0810 14:52:23.646949 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.646950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.646960 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.647013 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.647639 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.648118 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.649006 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.649183 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.649223 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.649903 (+ 680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.649905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.649905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:23.649909 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.649923 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:23.649927 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.649967 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.650035 (+ 68us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.650060 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:52:23.650279 17079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.646195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36307 (local address 127.19.29.193:48481)
0810 14:52:23.646375 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.646415 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.646876 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.647090 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.647093 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.647102 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:23.647576 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.647581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.648180 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.648180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.648946 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.648949 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.649234 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.649234 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.649350 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.649782 (+ 432us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:23.649782 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:23.649808 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:23.649829 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:23.649973 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:23.649975 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:23.649977 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.650032 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.650106 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":67,"threads_started":1}
I20260810 14:52:23.650715 17077 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36307
I20260810 14:52:23.650799 17077 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:23.650960 17077 heartbeater.cc:511] Master 127.19.29.254:36307 requested a full tablet report, sending...
I20260810 14:52:23.651378 16768 ts_manager.cc:194] Registered new tserver with Master: bacb067c30c94780993d6bd47e6fd2a8 (127.19.29.193:34045)
I20260810 14:52:23.651976 16768 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.193:48481
I20260810 14:52:23.654672 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 16856
I20260810 14:52:23.654763 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:23.654939 19575 external_mini_cluster.cc:1428] Setting key 3f31e2bb0fd66f9b2abe11805a964a10
I20260810 14:52:23.655740 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--builtin_ntp_servers=127.19.29.212:45285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:23.735920 17080 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:23.736117 17080 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:23.736138 17080 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:23.737226 17080 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:23.737263 17080 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:23.737286 17080 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:23.738595 17080 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17080
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:23.738804 17080 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:23.739061 17080 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:52:23.743784 17080 server_base.cc:1034] running on GCE node
W20260810 14:52:23.743806 17096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.743896 17087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.743893 17088 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:23.744179 17080 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:23.744405 17080 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:23.745571 17080 hybrid_clock.cc:648] HybridClock initialized: now 1786373543745558 us; error 27 us; skew 500 ppm
I20260810 14:52:23.746797 17080 webserver.cc:460] Webserver started at http://127.19.29.194:42233/ using document root <none> and password file <none>
I20260810 14:52:23.747009 17080 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:23.747059 17080 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:23.747185 17080 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:23.748169 17080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "7cdebaa258f59731ed0a17bbb803d3f4"
server_key_iv: "aba039b9166b6b1bf01674615cd7f056"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.748486 17080 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "7cdebaa258f59731ed0a17bbb803d3f4"
server_key_iv: "aba039b9166b6b1bf01674615cd7f056"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.749725 17080 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:52:23.750370 17106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.750517 17080 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.750602 17080 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "7cdebaa258f59731ed0a17bbb803d3f4"
server_key_iv: "aba039b9166b6b1bf01674615cd7f056"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.750666 17080 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:23.793141 17080 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:23.793457 17080 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:23.793579 17080 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:23.793797 17080 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:23.794142 17080 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:23.794186 17080 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.794210 17080 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:23.794234 17080 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.799621 17080 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:32889
I20260810 14:52:23.799692 17299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:32889 every 8 connection(s)
I20260810 14:52:23.799973 17080 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:23.801116 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 17080
I20260810 14:52:23.801224 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:23.801416 19575 external_mini_cluster.cc:1428] Setting key 56f4908872dfbd1bc7203d919229f9de
I20260810 14:52:23.802384 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--builtin_ntp_servers=127.19.29.212:45285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:52:23.805542 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.800645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:60651 (local address 127.19.29.254:36307)
0810 14:52:23.800692 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.800694 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.800901 (+ 207us) server_negotiation.cc:407] Connection header received
0810 14:52:23.801570 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.801572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.801588 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.801655 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.802460 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.802997 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.804277 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.804471 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.804527 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.805293 (+ 766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.805294 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.805295 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:23.805299 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.805315 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:23.805320 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.805364 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.805435 (+ 71us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.805464 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:23.805740 17306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.800614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36307 (local address 127.19.29.194:60651)
0810 14:52:23.800785 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.800818 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.801459 (+ 641us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.801710 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.801714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.801722 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:23.802271 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.802278 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.803094 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.803095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.804198 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.804201 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.804543 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.804545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.804677 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.805156 (+ 479us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:23.805157 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:23.805185 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:23.805216 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:23.805370 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:23.805376 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:23.805378 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.805440 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.805538 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260810 14:52:23.806245 17302 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36307
I20260810 14:52:23.806350 17302 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:23.806526 17302 heartbeater.cc:511] Master 127.19.29.254:36307 requested a full tablet report, sending...
I20260810 14:52:23.806891 16768 ts_manager.cc:194] Registered new tserver with Master: 7f8bf16ced7a491387a9dc8a8d4ca1df (127.19.29.194:32889)
I20260810 14:52:23.807243 16768 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.194:60651
W20260810 14:52:23.882015 17307 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:23.882207 17307 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:23.882236 17307 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:23.883369 17307 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:23.883411 17307 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:23.883445 17307 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:23.884764 17307 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36307
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17307
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:23.884981 17307 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:23.885267 17307 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:23.889889 17317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.889927 17316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:23.889894 17319 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:23.889991 17307 server_base.cc:1034] running on GCE node
I20260810 14:52:23.890316 17307 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:23.890542 17307 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:23.891708 17307 hybrid_clock.cc:648] HybridClock initialized: now 1786373543891695 us; error 35 us; skew 500 ppm
I20260810 14:52:23.892866 17307 webserver.cc:460] Webserver started at http://127.19.29.195:35843/ using document root <none> and password file <none>
I20260810 14:52:23.893065 17307 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:23.893112 17307 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:23.893263 17307 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:23.894349 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "32928cf4e8bc4d20891ec1345017bf4e"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "0648eae3b5e76347b4911a41c6bde3b8"
server_key_iv: "01919b31fa683958fc9df8955ee5e639"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.894701 17307 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "32928cf4e8bc4d20891ec1345017bf4e"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "0648eae3b5e76347b4911a41c6bde3b8"
server_key_iv: "01919b31fa683958fc9df8955ee5e639"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.895855 17307 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:23.896505 17330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.896663 17307 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:23.896739 17307 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "32928cf4e8bc4d20891ec1345017bf4e"
format_stamp: "Formatted at 2026-08-10 14:52:23 on dist-test-slave-4tdj"
server_key: "0648eae3b5e76347b4911a41c6bde3b8"
server_key_iv: "01919b31fa683958fc9df8955ee5e639"
server_key_version: "encryptionkey@0"
I20260810 14:52:23.896803 17307 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:23.928289 17307 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:23.928572 17307 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:23.928704 17307 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:23.928910 17307 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:23.929232 17307 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:23.929266 17307 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.929296 17307 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:23.929320 17307 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:23.934577 17307 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:38775
I20260810 14:52:23.934623 17532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:38775 every 8 connection(s)
I20260810 14:52:23.934919 17307 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:23.937690 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 17307
I20260810 14:52:23.937773 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:23.937942 19575 external_mini_cluster.cc:1428] Setting key 2c62c0c99fcd496d9ebb306bec97c992
I20260810 14:52:23.940074 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.935583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:56823 (local address 127.19.29.254:36307)
0810 14:52:23.935645 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.935647 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.935866 (+ 219us) server_negotiation.cc:407] Connection header received
0810 14:52:23.936321 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.936322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.936331 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.936386 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.936996 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.937479 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.938690 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.938955 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.939005 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.939795 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.939796 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.939797 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:23.939802 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.939817 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:23.939822 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.939864 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.939965 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.939995 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:52:23.940398 17538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.935545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36307 (local address 127.19.29.195:56823)
0810 14:52:23.935751 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.935791 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.936248 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.936439 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.936442 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.936450 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:23.936921 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.936925 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.937545 (+ 620us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.937546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.938608 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.938611 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.939021 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.939022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.939136 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.939642 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:23.939643 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:23.939677 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:23.939706 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:23.939892 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:23.939898 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:23.939901 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.939986 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.940155 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260810 14:52:23.940802 17534 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36307
I20260810 14:52:23.940881 17534 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:23.941043 17534 heartbeater.cc:511] Master 127.19.29.254:36307 requested a full tablet report, sending...
I20260810 14:52:23.941367 16768 ts_manager.cc:194] Registered new tserver with Master: 32928cf4e8bc4d20891ec1345017bf4e (127.19.29.195:38775)
I20260810 14:52:23.941727 16768 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.195:56823
I20260810 14:52:23.949407 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:23.953325 16828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.950690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40794 (local address 127.19.29.254:36307)
0810 14:52:23.950749 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.950751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.950837 (+ 86us) server_negotiation.cc:407] Connection header received
0810 14:52:23.950897 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.950898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.950910 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.950954 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:23.951114 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.951561 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.952272 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.952460 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.952511 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.953114 (+ 603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:23.953116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:23.953116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:23.953121 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:23.953135 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:23.953139 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:23.953183 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.953232 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.953257 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:52:23.954777 16768 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:23.956219 16768 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:23.961615 17545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38775 (local address 127.0.0.1:36622)
0810 14:52:23.958308 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.958348 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.958417 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.958607 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.958610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.958612 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.958670 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.958672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.959675 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.959676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.960596 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.960599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.961412 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.961413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.961471 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.961481 (+ 10us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.961527 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.961564 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":21,"thread_start_us":46,"threads_started":1}
I20260810 14:52:23.961649 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.19.29.195:38775)
0810 14:52:23.958413 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.958417 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.958428 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:52:23.958513 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.958515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.958529 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.958598 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.958731 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.959608 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.960674 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.961331 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.961396 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.961474 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.961539 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.961572 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":101,"threads_started":1}
I20260810 14:52:23.962275 17413 tablet_service.cc:1467] Processing CreateTablet for tablet d46f32a8153540459254c81c5f1f4aee (DEFAULT_TABLE table=test-table [id=c7ea4f94049a414ca43871b28d1642be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.962682 17413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f32a8153540459254c81c5f1f4aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.963256 17549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38932 (local address 127.19.29.194:32889)
0810 14:52:23.959692 (+ 1313us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.959696 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.959707 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:52:23.959746 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.959748 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.959763 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.959830 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.960003 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.961079 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.962186 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.962913 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.962978 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.963057 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.963143 (+ 86us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.963181 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":74,"threads_started":1}
I20260810 14:52:23.963286 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55858 (local address 127.19.29.193:34045)
0810 14:52:23.958814 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:23.958818 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:23.958828 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:23.958890 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:23.958892 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:23.958907 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:23.958981 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:23.959153 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.959871 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.962190 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.962736 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.962798 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.962881 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:23.963159 (+ 278us) server_negotiation.cc:299] Negotiation successful
0810 14:52:23.963206 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":333,"thread_start_us":89,"threads_started":1}
I20260810 14:52:23.963454 17554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:34045 (local address 127.0.0.1:55858)
0810 14:52:23.958652 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.958660 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.958708 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.959019 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.959020 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.959022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.959063 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.959064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.959947 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.959948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.961090 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.961093 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.962914 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.962915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.962963 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.962967 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.963012 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.963390 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":60,"threads_started":1}
I20260810 14:52:23.963682 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:23.958144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:32889 (local address 127.0.0.1:38932)
0810 14:52:23.958647 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:23.958656 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:23.958708 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:23.959895 (+ 1187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:23.959896 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:23.959899 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:23.959940 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.959941 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.961167 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.961168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.962110 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:23.962114 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:23.962999 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:23.963000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:23.963054 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:23.963056 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:23.963588 (+ 532us) client_negotiation.cc:240] Negotiation successful
0810 14:52:23.963628 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"mutex_wait_us":4,"thread_start_us":81,"threads_started":1}
I20260810 14:52:23.964397 17189 tablet_service.cc:1467] Processing CreateTablet for tablet d46f32a8153540459254c81c5f1f4aee (DEFAULT_TABLE table=test-table [id=c7ea4f94049a414ca43871b28d1642be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.964742 17189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f32a8153540459254c81c5f1f4aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.965837 17555 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Bootstrap starting.
I20260810 14:52:23.966405 16970 tablet_service.cc:1467] Processing CreateTablet for tablet d46f32a8153540459254c81c5f1f4aee (DEFAULT_TABLE table=test-table [id=c7ea4f94049a414ca43871b28d1642be]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:23.966542 17555 tablet_bootstrap.cc:654] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.966754 16970 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f32a8153540459254c81c5f1f4aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:23.966809 17555 log.cc:824] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.967442 17555 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: No bootstrap required, opened a new log
I20260810 14:52:23.967501 17555 ts_tablet_manager.cc:1397] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:23.967943 17564 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Bootstrap starting.
I20260810 14:52:23.968678 17564 tablet_bootstrap.cc:654] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.968986 17564 log.cc:824] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.969718 17564 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: No bootstrap required, opened a new log
I20260810 14:52:23.969789 17564 ts_tablet_manager.cc:1397] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:23.969786 17567 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Bootstrap starting.
I20260810 14:52:23.969862 17555 raft_consensus.cc:348] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.970014 17555 raft_consensus.cc:374] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.970060 17555 raft_consensus.cc:729] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32928cf4e8bc4d20891ec1345017bf4e, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.970176 17555 consensus_queue.cc:260] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.970444 17555 ts_tablet_manager.cc:1428] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 14:52:23.970463 17567 tablet_bootstrap.cc:654] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:23.970592 17534 heartbeater.cc:503] Master 127.19.29.254:36307 was elected leader, sending a full tablet report...
I20260810 14:52:23.970743 17567 log.cc:824] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:23.971486 17567 tablet_bootstrap.cc:492] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: No bootstrap required, opened a new log
I20260810 14:52:23.971617 17567 ts_tablet_manager.cc:1397] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:23.972018 17564 raft_consensus.cc:348] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.972194 17564 raft_consensus.cc:374] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.972237 17564 raft_consensus.cc:729] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f8bf16ced7a491387a9dc8a8d4ca1df, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.972344 17564 consensus_queue.cc:260] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.972601 17564 ts_tablet_manager.cc:1428] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:52:23.972640 17302 heartbeater.cc:503] Master 127.19.29.254:36307 was elected leader, sending a full tablet report...
I20260810 14:52:23.974102 17567 raft_consensus.cc:348] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.974217 17567 raft_consensus.cc:374] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:23.974237 17567 raft_consensus.cc:729] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bacb067c30c94780993d6bd47e6fd2a8, State: Initialized, Role: FOLLOWER
I20260810 14:52:23.974344 17567 consensus_queue.cc:260] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:23.974556 17567 ts_tablet_manager.cc:1428] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260810 14:52:23.974617 17077 heartbeater.cc:503] Master 127.19.29.254:36307 was elected leader, sending a full tablet report...
W20260810 14:52:24.050491 17305 tablet.cc:2369] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:52:24.146279 17078 tablet.cc:2369] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:52:24.185458 17537 tablet.cc:2369] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:24.219008 17573 raft_consensus.cc:482] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:24.219139 17573 raft_consensus.cc:504] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:24.219484 17573 leader_election.cc:288] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f8bf16ced7a491387a9dc8a8d4ca1df (127.19.29.194:32889), 32928cf4e8bc4d20891ec1345017bf4e (127.19.29.195:38775)
I20260810 14:52:24.222221 17547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.219755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:43503 (local address 127.19.29.195:38775)
0810 14:52:24.219813 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:24.219815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:24.219882 (+ 67us) server_negotiation.cc:407] Connection header received
0810 14:52:24.219944 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:24.219945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:24.219953 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:24.219998 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:24.220155 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.220614 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.221543 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.221909 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.221971 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:24.221979 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:24.222118 (+ 139us) server_negotiation.cc:299] Negotiation successful
0810 14:52:24.222156 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:52:24.222239 17549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.219736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:52843 (local address 127.19.29.194:32889)
0810 14:52:24.219783 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:24.219786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:24.219873 (+ 87us) server_negotiation.cc:407] Connection header received
0810 14:52:24.219933 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:24.219934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:24.219947 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:24.219993 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:24.220151 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.220642 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.221575 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.221929 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.221989 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:24.221997 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:24.222139 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 14:52:24.222174 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:52:24.222255 17574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.219668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:32889 (local address 127.19.29.193:52843)
0810 14:52:24.219806 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:24.219816 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:24.219876 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:24.220002 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:24.220003 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:24.220005 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:24.220082 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:24.220084 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.220714 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.220715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:24.221485 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:24.221487 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.222009 (+ 522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.222011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:24.222072 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:24.222076 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:24.222121 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:52:24.222160 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260810 14:52:24.222247 17577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.219694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:38775 (local address 127.19.29.193:43503)
0810 14:52:24.219814 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:24.219824 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:24.219888 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:24.220006 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:24.220007 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:24.220009 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:24.220099 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:24.220100 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.220681 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.220682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:24.221455 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:24.221457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.221980 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.221981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:24.222051 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:24.222055 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:24.222106 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 14:52:24.222147 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":59,"threads_started":1}
I20260810 14:52:24.222613 17226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f32a8153540459254c81c5f1f4aee" candidate_uuid: "bacb067c30c94780993d6bd47e6fd2a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" is_pre_election: true
I20260810 14:52:24.222783 17226 raft_consensus.cc:2454] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bacb067c30c94780993d6bd47e6fd2a8 in term 0.
I20260810 14:52:24.222751 17442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f32a8153540459254c81c5f1f4aee" candidate_uuid: "bacb067c30c94780993d6bd47e6fd2a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32928cf4e8bc4d20891ec1345017bf4e" is_pre_election: true
I20260810 14:52:24.222873 17442 raft_consensus.cc:2454] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bacb067c30c94780993d6bd47e6fd2a8 in term 0.
I20260810 14:52:24.223040 16893 leader_election.cc:302] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f8bf16ced7a491387a9dc8a8d4ca1df, bacb067c30c94780993d6bd47e6fd2a8; no voters:
I20260810 14:52:24.223191 17573 raft_consensus.cc:2781] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:24.223254 17573 raft_consensus.cc:482] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:24.223277 17573 raft_consensus.cc:3037] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:24.224002 17573 raft_consensus.cc:504] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:24.224129 17573 leader_election.cc:288] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7f8bf16ced7a491387a9dc8a8d4ca1df (127.19.29.194:32889), 32928cf4e8bc4d20891ec1345017bf4e (127.19.29.195:38775)
I20260810 14:52:24.224264 17226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f32a8153540459254c81c5f1f4aee" candidate_uuid: "bacb067c30c94780993d6bd47e6fd2a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df"
I20260810 14:52:24.224285 17442 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f32a8153540459254c81c5f1f4aee" candidate_uuid: "bacb067c30c94780993d6bd47e6fd2a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32928cf4e8bc4d20891ec1345017bf4e"
I20260810 14:52:24.224344 17442 raft_consensus.cc:3037] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:24.224344 17226 raft_consensus.cc:3037] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:24.225030 17442 raft_consensus.cc:2454] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bacb067c30c94780993d6bd47e6fd2a8 in term 1.
I20260810 14:52:24.225116 17226 raft_consensus.cc:2454] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bacb067c30c94780993d6bd47e6fd2a8 in term 1.
I20260810 14:52:24.225203 16890 leader_election.cc:302] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32928cf4e8bc4d20891ec1345017bf4e, bacb067c30c94780993d6bd47e6fd2a8; no voters:
I20260810 14:52:24.225302 17573 raft_consensus.cc:2781] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:24.225448 17573 raft_consensus.cc:686] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [term 1 LEADER]: Becoming Leader. State: Replica: bacb067c30c94780993d6bd47e6fd2a8, State: Running, Role: LEADER
I20260810 14:52:24.225543 17573 consensus_queue.cc:237] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } }
I20260810 14:52:24.226393 16768 catalog_manager.cc:5495] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to bacb067c30c94780993d6bd47e6fd2a8 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "bacb067c30c94780993d6bd47e6fd2a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bacb067c30c94780993d6bd47e6fd2a8" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 34045 } health_report { overall_health: HEALTHY } } }
I20260810 14:52:24.241850 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.239693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55864 (local address 127.19.29.193:34045)
0810 14:52:24.239745 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:24.239747 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:24.239755 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:24.239808 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:24.239808 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:24.239825 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:24.239881 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:24.239979 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.240423 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.241123 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:24.241294 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:24.241337 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:24.241582 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:24.241686 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:24.241757 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:24.241774 (+ 17us) server_negotiation.cc:299] Negotiation successful
0810 14:52:24.241790 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:52:24.243427 17442 raft_consensus.cc:1261] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 1 FOLLOWER]: Refusing update from remote peer bacb067c30c94780993d6bd47e6fd2a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:24.243428 17226 raft_consensus.cc:1261] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 1 FOLLOWER]: Refusing update from remote peer bacb067c30c94780993d6bd47e6fd2a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:24.243719 17578 consensus_queue.cc:1035] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32928cf4e8bc4d20891ec1345017bf4e" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 38775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:24.243835 17573 consensus_queue.cc:1035] T d46f32a8153540459254c81c5f1f4aee P bacb067c30c94780993d6bd47e6fd2a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f8bf16ced7a491387a9dc8a8d4ca1df" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 32889 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:24.246037 17583 mvcc.cc:205] Tried to move back new op lower bound from 7316986037219037184 to 7316986037148463104. Current Snapshot: MvccSnapshot[applied={T|T < 7316986037219037184}]
I20260810 14:52:24.246570 17584 mvcc.cc:205] Tried to move back new op lower bound from 7316986037219037184 to 7316986037148463104. Current Snapshot: MvccSnapshot[applied={T|T < 7316986037219037184}]
I20260810 14:52:24.246693 17585 mvcc.cc:205] Tried to move back new op lower bound from 7316986037219037184 to 7316986037148463104. Current Snapshot: MvccSnapshot[applied={T|T < 7316986037219037184 or (T in {7316986037219037184})}]
I20260810 14:52:24.248054 16767 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:24.248131 16767 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:24.248821 16767 catalog_manager.cc:5782] T 00000000000000000000000000000000 P be77fb78de1240438eeac346a1297300: Sending DeleteTablet for 3 replicas of tablet d46f32a8153540459254c81c5f1f4aee
I20260810 14:52:24.249121 17413 tablet_service.cc:1514] Processing DeleteTablet for tablet d46f32a8153540459254c81c5f1f4aee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:24 UTC) from {username='slave'} at 127.0.0.1:36622
I20260810 14:52:24.249154 16970 tablet_service.cc:1514] Processing DeleteTablet for tablet d46f32a8153540459254c81c5f1f4aee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:24 UTC) from {username='slave'} at 127.0.0.1:55858
I20260810 14:52:24.249316 17189 tablet_service.cc:1514] Processing DeleteTablet for tablet d46f32a8153540459254c81c5f1f4aee with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:24 UTC) from {username='slave'} at 127.0.0.1:38932
I20260810 14:52:24.249491 17601 tablet_replica.cc:330] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: stopping tablet replica
I20260810 14:52:24.249583 17601 raft_consensus.cc:2229] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:24.249598 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 16856
I20260810 14:52:24.249678 17601 raft_consensus.cc:2258] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:24.252457 17601 ts_tablet_manager.cc:1905] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:24.254249 17601 ts_tablet_manager.cc:1918] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:24.254354 17601 log.cc:1196] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/d46f32a8153540459254c81c5f1f4aee
I20260810 14:52:24.254621 17601 ts_tablet_manager.cc:1939] T d46f32a8153540459254c81c5f1f4aee P 7f8bf16ced7a491387a9dc8a8d4ca1df: Deleting consensus metadata
I20260810 14:52:24.259274 17598 tablet_replica.cc:330] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: stopping tablet replica
I20260810 14:52:24.259397 17598 raft_consensus.cc:2229] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:24.259500 17598 raft_consensus.cc:2258] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:24.259805 16749 catalog_manager.cc:4841] TS 7f8bf16ced7a491387a9dc8a8d4ca1df (127.19.29.194:32889): tablet d46f32a8153540459254c81c5f1f4aee (table test-table [id=c7ea4f94049a414ca43871b28d1642be]) successfully deleted
I20260810 14:52:24.260159 17598 ts_tablet_manager.cc:1905] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:24.261716 17598 ts_tablet_manager.cc:1918] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:24.261791 17598 log.cc:1196] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/d46f32a8153540459254c81c5f1f4aee
I20260810 14:52:24.262022 17598 ts_tablet_manager.cc:1939] T d46f32a8153540459254c81c5f1f4aee P 32928cf4e8bc4d20891ec1345017bf4e: Deleting consensus metadata
I20260810 14:52:24.262468 16746 catalog_manager.cc:4841] TS 32928cf4e8bc4d20891ec1345017bf4e (127.19.29.195:38775): tablet d46f32a8153540459254c81c5f1f4aee (table test-table [id=c7ea4f94049a414ca43871b28d1642be]) successfully deleted
W20260810 14:52:24.264482 16746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:34045 (error 108)
I20260810 14:52:24.264647 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 17080
I20260810 14:52:24.265334 17544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:24.264821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:34045 (local address 127.0.0.1:55878)
0810 14:52:24.265250 (+ 429us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:24.265301 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:34045: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403}
W20260810 14:52:24.265461 16746 catalog_manager.cc:4584] TS bacb067c30c94780993d6bd47e6fd2a8 (127.19.29.193:34045): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d46f32a8153540459254c81c5f1f4aee: Network error: Client connection negotiation failed: client connection to 127.19.29.193:34045: connect: Connection refused (error 111)
I20260810 14:52:24.279448 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 17307
I20260810 14:52:24.288349 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 16713
2026-08-10T14:52:24Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (953 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:24 dist-test-slave-4tdj krb5kdc[17611](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:24 dist-test-slave-4tdj krb5kdc[17611](info): set up 2 sockets
Aug 10 14:52:24 dist-test-slave-4tdj krb5kdc[17611](info): commencing operation
krb5kdc: starting...
W20260810 14:52:25.452824 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.140s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:25.565639 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:43165
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:43165
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:25.644637 17634 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:25.644833 17634 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:25.644865 17634 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:25.645987 17634 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:25.646025 17634 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:25.646044 17634 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:25.646059 17634 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:25.646075 17634 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:25.647519 17634 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:43165
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:43165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17634
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:25.647744 17634 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:25.647938 17634 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:25.652645 17649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:25.652652 17643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:25.652782 17634 server_base.cc:1034] running on GCE node
W20260810 14:52:25.652632 17653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:25.653122 17634 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:25.653365 17634 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:25.654495 17634 hybrid_clock.cc:648] HybridClock initialized: now 1786373545654481 us; error 30 us; skew 500 ppm
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:25.656841 17634 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:25.657255 17634 webserver.cc:460] Webserver started at http://127.19.29.254:34837/ using document root <none> and password file <none>
I20260810 14:52:25.657419 17634 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:25.657456 17634 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:25.657547 17634 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:25.658533 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "ca7967f06c2044cebc7d231a1c26b745"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "8ec1e9d334f6b536ca96b988304f3b76"
server_key_iv: "6cc725c007bf7924d46ac2585910bb7d"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.658818 17634 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "ca7967f06c2044cebc7d231a1c26b745"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "8ec1e9d334f6b536ca96b988304f3b76"
server_key_iv: "6cc725c007bf7924d46ac2585910bb7d"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.659926 17634 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:25.660552 17663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:25.660698 17634 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:25.660781 17634 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "ca7967f06c2044cebc7d231a1c26b745"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "8ec1e9d334f6b536ca96b988304f3b76"
server_key_iv: "6cc725c007bf7924d46ac2585910bb7d"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.660836 17634 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:25.693113 17634 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:25.694900 17634 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:25.695031 17634 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:25.698825 17634 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:43165
I20260810 14:52:25.698879 17756 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:43165 every 8 connection(s)
I20260810 14:52:25.699183 17634 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:25.700013 17758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:25.700238 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 17634
I20260810 14:52:25.700337 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:25.700503 19575 external_mini_cluster.cc:1428] Setting key a4ebc3f91edc9f1ce0bc93a21a65115c
I20260810 14:52:25.702972 17758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: Bootstrap starting.
I20260810 14:52:25.703660 17758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:25.703977 17758 log.cc:824] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:25.704643 17758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: No bootstrap required, opened a new log
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:25.706761 17758 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } }
I20260810 14:52:25.706885 17758 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:25.706931 17758 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7967f06c2044cebc7d231a1c26b745, State: Initialized, Role: FOLLOWER
I20260810 14:52:25.707054 17758 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } }
I20260810 14:52:25.707119 17758 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:25.707139 17758 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:25.707182 17758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:25.707816 17758 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } }
I20260810 14:52:25.707924 17758 leader_election.cc:302] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca7967f06c2044cebc7d231a1c26b745; no voters:
I20260810 14:52:25.708079 17758 leader_election.cc:288] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:25.708127 17767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:25.708285 17767 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [term 1 LEADER]: Becoming Leader. State: Replica: ca7967f06c2044cebc7d231a1c26b745, State: Running, Role: LEADER
I20260810 14:52:25.708331 17758 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:25.708375 17767 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } }
I20260810 14:52:25.708772 17770 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca7967f06c2044cebc7d231a1c26b745" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } } }
I20260810 14:52:25.708847 17770 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:25.709013 17767 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca7967f06c2044cebc7d231a1c26b745. Latest consensus state: current_term: 1 leader_uuid: "ca7967f06c2044cebc7d231a1c26b745" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca7967f06c2044cebc7d231a1c26b745" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 43165 } } }
I20260810 14:52:25.709091 17767 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:25.709693 17778 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:25.710351 17778 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:25.710836 17763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:25.700988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54478 (local address 127.19.29.254:43165)
0810 14:52:25.701188 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:25.701197 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:25.701231 (+ 34us) server_negotiation.cc:407] Connection header received
0810 14:52:25.701729 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:25.701738 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:25.701799 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:25.701939 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:25.702521 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.703841 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.704546 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.705121 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.705238 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:25.707333 (+ 2095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:25.707337 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:25.707337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:25.707348 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:25.709112 (+ 1764us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:25.709593 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:25.709596 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:25.709597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:25.709702 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:25.709931 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:25.709932 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:25.709932 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:25.710233 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:25.710402 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:25.710519 (+ 117us) server_negotiation.cc:299] Negotiation successful
0810 14:52:25.710651 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":81,"threads_started":1}
I20260810 14:52:25.711799 17778 catalog_manager.cc:1347] Generated new cluster ID: 8de308e9f46e480c9224dff595ba87e8
I20260810 14:52:25.711848 17778 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:25.727015 17778 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:25.727499 17778 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:25.732761 17778 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: Generated new TSK 0
I20260810 14:52:25.732906 17778 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:52:25.758579 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:25.837697 17802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:25.837882 17802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:25.837904 17802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:25.839025 17802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:25.839066 17802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:25.839090 17802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:25.840476 17802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:25.840675 17802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:25.840878 17802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:25.845626 17810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:25.845733 17811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:25.845652 17816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:25.845703 17802 server_base.cc:1034] running on GCE node
I20260810 14:52:25.845973 17802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:25.846186 17802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:25.847333 17802 hybrid_clock.cc:648] HybridClock initialized: now 1786373545847314 us; error 29 us; skew 500 ppm
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:25.849836 17802 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:52:25.850226 17802 webserver.cc:460] Webserver started at http://127.19.29.193:44105/ using document root <none> and password file <none>
I20260810 14:52:25.850433 17802 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:25.850486 17802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:25.850579 17802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:25.851534 17802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "6c1210ed9a20bfcb4ea22a7dc513c03d"
server_key_iv: "fb3c91763ae16d78726352708e9b13e6"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.851838 17802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "6c1210ed9a20bfcb4ea22a7dc513c03d"
server_key_iv: "fb3c91763ae16d78726352708e9b13e6"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.853047 17802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:25.853729 17831 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:25.853861 17802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:25.853947 17802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "6c1210ed9a20bfcb4ea22a7dc513c03d"
server_key_iv: "fb3c91763ae16d78726352708e9b13e6"
server_key_version: "encryptionkey@0"
I20260810 14:52:25.854027 17802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:25.865023 17802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:25.867107 17802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:25.867231 17802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:25.867446 17802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:25.867734 17802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:25.867770 17802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:25.867794 17802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:25.867821 17802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:25.873798 17802 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:41653
I20260810 14:52:25.873862 18032 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:41653 every 8 connection(s)
I20260810 14:52:25.874133 17802 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:25.882835 17763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:25.874830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:58367 (local address 127.19.29.254:43165)
0810 14:52:25.874877 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:25.874879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:25.875047 (+ 168us) server_negotiation.cc:407] Connection header received
0810 14:52:25.875474 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:25.875475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:25.875487 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:25.875553 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:25.876436 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.876947 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.877928 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.878135 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.878187 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:25.880119 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:25.880121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:25.880121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:25.880129 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:25.881436 (+ 1307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:25.881976 (+ 540us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:25.881977 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:25.881977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:25.882033 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:25.882334 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:25.882335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:25.882335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:25.882445 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:25.882517 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:25.882709 (+ 192us) server_negotiation.cc:299] Negotiation successful
0810 14:52:25.882774 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:52:25.882941 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 17802
I20260810 14:52:25.883060 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:25.883060 18036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:25.874779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43165 (local address 127.19.29.193:58367)
0810 14:52:25.874930 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:25.874967 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:25.875398 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:25.875602 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:25.875605 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:25.876170 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:25.876345 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:25.876350 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.877072 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.877074 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:25.877857 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:25.877859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:25.878199 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:25.878199 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:25.878311 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:25.878705 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:25.878713 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:25.880031 (+ 1318us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:25.881670 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:25.881679 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:25.881680 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:25.881911 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:25.882112 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:25.882113 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:25.882113 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:25.882235 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:25.882510 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:25.882514 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:25.882619 (+ 105us) client_negotiation.cc:769] Sending connection context
0810 14:52:25.882697 (+ 78us) client_negotiation.cc:240] Negotiation successful
0810 14:52:25.882850 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260810 14:52:25.883257 19575 external_mini_cluster.cc:1428] Setting key 46383ac7b00a95e164880057ef39ea17
I20260810 14:52:25.883533 18034 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43165
I20260810 14:52:25.883627 18034 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:25.883795 18034 heartbeater.cc:511] Master 127.19.29.254:43165 requested a full tablet report, sending...
I20260810 14:52:25.884311 17692 ts_manager.cc:194] Registered new tserver with Master: 370ccaaeb6294f61b7c8bc1ea43d30eb (127.19.29.193:41653)
I20260810 14:52:25.885067 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:58367
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:52:25.907049 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:25.985806 18043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:25.986008 18043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:25.986042 18043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:25.987190 18043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:25.987231 18043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:25.987264 18043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:25.988688 18043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:25.988914 18043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:25.989112 18043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:25.993870 18052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:25.993883 18053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:25.993908 18056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:25.994151 18043 server_base.cc:1034] running on GCE node
I20260810 14:52:25.994355 18043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:25.994592 18043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:25.995736 18043 hybrid_clock.cc:648] HybridClock initialized: now 1786373545995721 us; error 28 us; skew 500 ppm
Aug 10 14:52:25 dist-test-slave-4tdj krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:25.998044 18043 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:52:25.998518 18043 webserver.cc:460] Webserver started at http://127.19.29.194:39783/ using document root <none> and password file <none>
I20260810 14:52:25.998731 18043 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:25.998777 18043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:25.998903 18043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:25.999931 18043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "f0a03dbe4db641e5ac1c5f39a658f681"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "c1a29174d6bb9cf1996eadf982838685"
server_key_iv: "64ffacf769c6340af9c60aa0ae86c92e"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.000277 18043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "f0a03dbe4db641e5ac1c5f39a658f681"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "c1a29174d6bb9cf1996eadf982838685"
server_key_iv: "64ffacf769c6340af9c60aa0ae86c92e"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.001518 18043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:26.002215 18070 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.002404 18043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:26.002492 18043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "f0a03dbe4db641e5ac1c5f39a658f681"
format_stamp: "Formatted at 2026-08-10 14:52:25 on dist-test-slave-4tdj"
server_key: "c1a29174d6bb9cf1996eadf982838685"
server_key_iv: "64ffacf769c6340af9c60aa0ae86c92e"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.002562 18043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:26.020964 18043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:26.022722 18043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:26.022858 18043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:26.023074 18043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:26.023387 18043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:26.023422 18043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.023448 18043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:26.023466 18043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.028982 18043 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:37091
I20260810 14:52:26.029064 18255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:37091 every 8 connection(s)
I20260810 14:52:26.029340 18043 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:26.031529 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 18043
I20260810 14:52:26.031621 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:26.031800 19575 external_mini_cluster.cc:1428] Setting key eb88bb5efc91b6dbb34487d3a8a9acaf
Aug 10 14:52:26 dist-test-slave-4tdj krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373545, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:26.039037 17763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.029986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:54425 (local address 127.19.29.254:43165)
0810 14:52:26.030055 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.030057 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.030234 (+ 177us) server_negotiation.cc:407] Connection header received
0810 14:52:26.030757 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.030758 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.030768 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.030820 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:26.031717 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.032406 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.033731 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.033918 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.033965 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.036324 (+ 2359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:26.036326 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:26.036326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:26.036333 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:26.037648 (+ 1315us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.038105 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.038106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.038106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.038152 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.038440 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.038441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.038441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.038541 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:26.038590 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.038897 (+ 307us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.038966 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 14:52:26.039263 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.029953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43165 (local address 127.19.29.194:54425)
0810 14:52:26.030109 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.030145 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.030675 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.030873 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.030877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.031423 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:26.031628 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.031635 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.032516 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.032518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.033647 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.033650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.033988 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.033989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.034141 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.034701 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:26.034709 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:26.036236 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:26.037730 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:26.037738 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:26.037740 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:26.038034 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:26.038206 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:26.038207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:26.038207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:26.038380 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:26.038604 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:26.038610 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:26.038771 (+ 161us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.038878 (+ 107us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.039042 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260810 14:52:26.039832 18258 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43165
I20260810 14:52:26.039934 18258 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:26.040129 18258 heartbeater.cc:511] Master 127.19.29.254:43165 requested a full tablet report, sending...
I20260810 14:52:26.040470 17692 ts_manager.cc:194] Registered new tserver with Master: f0a03dbe4db641e5ac1c5f39a658f681 (127.19.29.194:37091)
I20260810 14:52:26.040851 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:54425
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:52:26.056052 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:26.135604 18269 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:26.135799 18269 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:26.135829 18269 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:26.136932 18269 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:26.136972 18269 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:26.137006 18269 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:26.138451 18269 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:43165
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18269
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:26.138687 18269 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:26.138897 18269 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:26.143720 18282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:26.143739 18276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:26.143858 18278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:26.143888 18269 server_base.cc:1034] running on GCE node
I20260810 14:52:26.144081 18269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:26.144309 18269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:26.145452 18269 hybrid_clock.cc:648] HybridClock initialized: now 1786373546145435 us; error 28 us; skew 500 ppm
Aug 10 14:52:26 dist-test-slave-4tdj krb5kdc[17611](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373546, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:26.147786 18269 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:52:26.148175 18269 webserver.cc:460] Webserver started at http://127.19.29.195:37929/ using document root <none> and password file <none>
I20260810 14:52:26.148384 18269 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:26.148434 18269 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:26.148555 18269 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:26.149515 18269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "68fd221a8ae18afe4b1cb64398e4773b"
server_key_iv: "5483fbea2206647bc12faa75bc248e6f"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.149859 18269 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "68fd221a8ae18afe4b1cb64398e4773b"
server_key_iv: "5483fbea2206647bc12faa75bc248e6f"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.151135 18269 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:26.151795 18291 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.151947 18269 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.152031 18269 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "68fd221a8ae18afe4b1cb64398e4773b"
server_key_iv: "5483fbea2206647bc12faa75bc248e6f"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.152088 18269 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:26.175091 18269 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:26.176867 18269 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:26.177001 18269 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:26.177213 18269 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:26.177505 18269 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:26.177538 18269 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.177567 18269 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:26.177590 18269 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.183157 18269 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:34725
I20260810 14:52:26.183224 18487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:34725 every 8 connection(s)
I20260810 14:52:26.183511 18269 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
Aug 10 14:52:26 dist-test-slave-4tdj krb5kdc[17611](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373546, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:26.190780 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 18269
I20260810 14:52:26.190876 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:26.191087 19575 external_mini_cluster.cc:1428] Setting key 42d70830a0cba0d461369c69b2ce5d11
I20260810 14:52:26.192315 17763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.184195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:53733 (local address 127.19.29.254:43165)
0810 14:52:26.184268 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.184270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.184448 (+ 178us) server_negotiation.cc:407] Connection header received
0810 14:52:26.184961 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.184962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.184975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.185027 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:26.185988 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.186563 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.187539 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.187739 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.187795 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.189711 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:26.189712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:26.189713 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:26.189720 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:26.190923 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.191363 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.191364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.191365 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.191424 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.191696 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.191697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.191697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.191840 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:26.191907 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.192179 (+ 272us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.192252 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260810 14:52:26.192456 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.184149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:43165 (local address 127.19.29.195:53733)
0810 14:52:26.184326 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.184368 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.184857 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.185099 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.185104 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.185689 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:26.185888 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.185894 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.186658 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.186659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.187449 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.187452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.187810 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.187811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.187933 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.188332 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:26.188340 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:26.189618 (+ 1278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:26.190994 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:26.191003 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:26.191005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:26.191292 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:26.191486 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:26.191486 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:26.191487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:26.191634 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:26.191903 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:26.191909 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:26.192061 (+ 152us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.192156 (+ 95us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.192279 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260810 14:52:26.192848 18488 heartbeater.cc:347] Connected to a master server at 127.19.29.254:43165
I20260810 14:52:26.192941 18488 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:26.193110 18488 heartbeater.cc:511] Master 127.19.29.254:43165 requested a full tablet report, sending...
I20260810 14:52:26.193465 17692 ts_manager.cc:194] Registered new tserver with Master: 1115b2e59ee44ae4842ad3f0f9cb7b7a (127.19.29.195:34725)
I20260810 14:52:26.193799 17692 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:53733
I20260810 14:52:26.202734 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:26.210237 17763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.203970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54492 (local address 127.19.29.254:43165)
0810 14:52:26.204010 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.204012 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.204155 (+ 143us) server_negotiation.cc:407] Connection header received
0810 14:52:26.204209 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.204209 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.204218 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.204254 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:26.204796 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.205319 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.205993 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.206190 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.206248 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.207370 (+ 1122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:26.207371 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:26.207371 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:26.207377 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:26.208765 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.209252 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.209253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.209253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.209305 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:26.209612 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:26.209613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:26.209613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:26.209786 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:26.209899 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.210081 (+ 182us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.210137 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:26.211874 17692 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54492:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:26.213327 17692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:26.219234 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41653 (local address 127.0.0.1:53346)
0810 14:52:26.215484 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.215521 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.215577 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.216231 (+ 654us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.216232 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.216234 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.216276 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.216277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.217456 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.217457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.218321 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.218324 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.218951 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.218952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.219031 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.219045 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.219108 (+ 63us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.219161 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":56,"threads_started":1}
I20260810 14:52:26.219254 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53346 (local address 127.19.29.193:41653)
0810 14:52:26.215866 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.215870 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.215880 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:26.216035 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.216042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.216063 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.216144 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.216361 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.217370 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.218385 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.218873 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.218937 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.218999 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.219131 (+ 132us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.219170 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260810 14:52:26.219460 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:34725 (local address 127.0.0.1:46692)
0810 14:52:26.215490 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.215525 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.215581 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.216094 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.216095 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.216098 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.216162 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.216163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.217048 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.217049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.218335 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.218337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.219232 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.219233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.219308 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.219312 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.219339 (+ 27us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.219380 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260810 14:52:26.219476 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215245 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:37091 (local address 127.0.0.1:43474)
0810 14:52:26.215657 (+ 412us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.215666 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.215706 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.215872 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.215875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.215878 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.215941 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.215943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.217217 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.217218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.218323 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.218326 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.219284 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.219285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.219335 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.219338 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.219379 (+ 41us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.219411 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":47,"threads_started":1}
I20260810 14:52:26.219751 18505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43474 (local address 127.19.29.194:37091)
0810 14:52:26.215688 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.215693 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.215710 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:52:26.215765 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.215767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.215779 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.215850 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.215996 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.217116 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.218421 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.219131 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.219201 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.219257 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.219514 (+ 257us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.219670 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":112,"threads_started":1}
I20260810 14:52:26.219877 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.215335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46692 (local address 127.19.29.195:34725)
0810 14:52:26.215929 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.215933 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.215941 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:26.215974 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.215976 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.215991 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.216232 (+ 241us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.216286 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.216961 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.218420 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.219137 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.219672 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.219735 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.219761 (+ 26us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.219800 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":93,"threads_started":1}
I20260810 14:52:26.220288 17908 tablet_service.cc:1467] Processing CreateTablet for tablet 1427768fb25043268a00b838e2bc18a1 (DEFAULT_TABLE table=test-table [id=263c7cba7b4149c6b5c5012978d42e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:26.220489 18372 tablet_service.cc:1467] Processing CreateTablet for tablet 1427768fb25043268a00b838e2bc18a1 (DEFAULT_TABLE table=test-table [id=263c7cba7b4149c6b5c5012978d42e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:26.220685 17908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1427768fb25043268a00b838e2bc18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:26.220785 18372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1427768fb25043268a00b838e2bc18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:26.224023 18508 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Bootstrap starting.
I20260810 14:52:26.224509 18152 tablet_service.cc:1467] Processing CreateTablet for tablet 1427768fb25043268a00b838e2bc18a1 (DEFAULT_TABLE table=test-table [id=263c7cba7b4149c6b5c5012978d42e24]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:26.224751 18508 tablet_bootstrap.cc:654] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:26.224818 18152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1427768fb25043268a00b838e2bc18a1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:26.225266 18508 log.cc:824] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:26.225633 18507 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Bootstrap starting.
I20260810 14:52:26.226082 18508 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: No bootstrap required, opened a new log
I20260810 14:52:26.226163 18508 ts_tablet_manager.cc:1397] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:26.226199 18507 tablet_bootstrap.cc:654] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:26.226818 18507 log.cc:824] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:26.227447 18507 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: No bootstrap required, opened a new log
I20260810 14:52:26.227509 18507 ts_tablet_manager.cc:1397] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:26.228063 18511 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Bootstrap starting.
I20260810 14:52:26.228116 18508 raft_consensus.cc:348] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.228293 18508 raft_consensus.cc:374] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:26.228334 18508 raft_consensus.cc:729] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370ccaaeb6294f61b7c8bc1ea43d30eb, State: Initialized, Role: FOLLOWER
I20260810 14:52:26.228469 18508 consensus_queue.cc:260] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.228736 18508 ts_tablet_manager.cc:1428] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260810 14:52:26.228752 18511 tablet_bootstrap.cc:654] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:26.229089 18034 heartbeater.cc:503] Master 127.19.29.254:43165 was elected leader, sending a full tablet report...
I20260810 14:52:26.229355 18511 log.cc:824] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:26.229967 18507 raft_consensus.cc:348] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.230157 18511 tablet_bootstrap.cc:492] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: No bootstrap required, opened a new log
I20260810 14:52:26.230149 18507 raft_consensus.cc:374] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:26.230194 18507 raft_consensus.cc:729] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1115b2e59ee44ae4842ad3f0f9cb7b7a, State: Initialized, Role: FOLLOWER
I20260810 14:52:26.230222 18511 ts_tablet_manager.cc:1397] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:26.230355 18507 consensus_queue.cc:260] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.232246 18511 raft_consensus.cc:348] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.232426 18511 raft_consensus.cc:374] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:26.232462 18511 raft_consensus.cc:729] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0a03dbe4db641e5ac1c5f39a658f681, State: Initialized, Role: FOLLOWER
I20260810 14:52:26.232584 18511 consensus_queue.cc:260] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.232779 18507 ts_tablet_manager.cc:1428] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20260810 14:52:26.232823 18488 heartbeater.cc:503] Master 127.19.29.254:43165 was elected leader, sending a full tablet report...
I20260810 14:52:26.232906 18258 heartbeater.cc:503] Master 127.19.29.254:43165 was elected leader, sending a full tablet report...
I20260810 14:52:26.232892 18511 ts_tablet_manager.cc:1428] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
W20260810 14:52:26.279888 18259 tablet.cc:2369] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:52:26.374919 18035 tablet.cc:2369] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:52:26.434085 18489 tablet.cc:2369] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:26.528808 18521 raft_consensus.cc:482] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:26.528941 18521 raft_consensus.cc:504] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.529353 18521 leader_election.cc:288] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 370ccaaeb6294f61b7c8bc1ea43d30eb (127.19.29.193:41653), 1115b2e59ee44ae4842ad3f0f9cb7b7a (127.19.29.195:34725)
I20260810 14:52:26.531600 18517 raft_consensus.cc:482] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:26.531724 18517 raft_consensus.cc:504] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.532096 18517 leader_election.cc:288] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1115b2e59ee44ae4842ad3f0f9cb7b7a (127.19.29.195:34725), f0a03dbe4db641e5ac1c5f39a658f681 (127.19.29.194:37091)
I20260810 14:52:26.532608 18263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.529582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:34725 (local address 127.19.29.194:52271)
0810 14:52:26.529647 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.529661 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.529722 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.529903 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.529904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.529906 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.529979 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.529981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.530694 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.530695 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.531444 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.531447 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.532353 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.532354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.532439 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.532443 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.532494 (+ 51us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.532535 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260810 14:52:26.532660 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.529670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:37143 (local address 127.19.29.193:41653)
0810 14:52:26.529752 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.529755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.529949 (+ 194us) server_negotiation.cc:407] Connection header received
0810 14:52:26.530019 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.530020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.530034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.530083 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.530248 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.530773 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.531782 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.532278 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.532325 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.532334 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.532554 (+ 220us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.532597 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:52:26.532795 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.529725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:52271 (local address 127.19.29.195:34725)
0810 14:52:26.529796 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.529799 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.529807 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:26.529834 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.529835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.529843 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.529890 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.530044 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.530620 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.531551 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.532040 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.532106 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.532116 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.532694 (+ 578us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.532735 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260810 14:52:26.532883 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.529582 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41653 (local address 127.19.29.194:37143)
0810 14:52:26.529879 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.529888 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.529949 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.530095 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.530096 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.530097 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.530173 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.530174 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.530847 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.530848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.531682 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.531685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.532396 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.532397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.532468 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.532472 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.532765 (+ 293us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.532805 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":170,"thread_start_us":66,"threads_started":1}
I20260810 14:52:26.533214 17947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" is_pre_election: true
I20260810 14:52:26.533331 17947 raft_consensus.cc:2454] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a03dbe4db641e5ac1c5f39a658f681 in term 0.
I20260810 14:52:26.533546 18071 leader_election.cc:302] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 370ccaaeb6294f61b7c8bc1ea43d30eb, f0a03dbe4db641e5ac1c5f39a658f681; no voters:
I20260810 14:52:26.533841 18404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" is_pre_election: true
I20260810 14:52:26.533995 18404 raft_consensus.cc:2454] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0a03dbe4db641e5ac1c5f39a658f681 in term 0.
I20260810 14:52:26.534121 18521 raft_consensus.cc:2781] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:26.534188 18521 raft_consensus.cc:482] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:26.534209 18521 raft_consensus.cc:3037] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:26.535069 18521 raft_consensus.cc:504] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.535349 18404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a"
I20260810 14:52:26.535378 17947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb"
I20260810 14:52:26.535436 17947 raft_consensus.cc:3037] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:26.535426 18404 raft_consensus.cc:3037] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:26.535640 18505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.532385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:37055 (local address 127.19.29.194:37091)
0810 14:52:26.532421 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.532423 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.532564 (+ 141us) server_negotiation.cc:407] Connection header received
0810 14:52:26.532648 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.532649 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.532657 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.532684 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.532893 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.533485 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.534809 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.535306 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.535360 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.535367 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.535545 (+ 178us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.535591 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:26.535635 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.532248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:34725 (local address 127.19.29.193:45303)
0810 14:52:26.532477 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.532486 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.532537 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.532726 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.532727 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.532729 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.532794 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.532795 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.533557 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.533558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.534605 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.534608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.535387 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.535388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.535465 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.535471 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.535515 (+ 44us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.535554 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":4,"thread_start_us":53,"threads_started":1}
I20260810 14:52:26.535838 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.532248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:37091 (local address 127.19.29.193:37055)
0810 14:52:26.532507 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.532518 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.532588 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.532737 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.532738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.532740 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:26.532817 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.532819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.533576 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.533577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.534716 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.534719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.535393 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.535394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.535465 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.535471 (+ 6us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.535733 (+ 262us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.535773 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":246,"mutex_wait_us":46,"thread_start_us":54,"threads_started":1}
I20260810 14:52:26.535903 18528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.532282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:45303 (local address 127.19.29.195:34725)
0810 14:52:26.532438 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.532439 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.532598 (+ 159us) server_negotiation.cc:407] Connection header received
0810 14:52:26.532621 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.532622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.532631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.532688 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:26.532867 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.533473 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.534680 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.535275 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.535341 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.535350 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.535792 (+ 442us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.535835 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
I20260810 14:52:26.536094 18186 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" is_pre_election: true
I20260810 14:52:26.536149 18402 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1427768fb25043268a00b838e2bc18a1" candidate_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" is_pre_election: true
I20260810 14:52:26.536201 18186 raft_consensus.cc:2379] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 370ccaaeb6294f61b7c8bc1ea43d30eb in current term 1: Already voted for candidate f0a03dbe4db641e5ac1c5f39a658f681 in this term.
I20260810 14:52:26.536254 18404 raft_consensus.cc:2454] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a03dbe4db641e5ac1c5f39a658f681 in term 1.
I20260810 14:52:26.536253 17947 raft_consensus.cc:2454] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0a03dbe4db641e5ac1c5f39a658f681 in term 1.
I20260810 14:52:26.536403 18077 leader_election.cc:302] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1115b2e59ee44ae4842ad3f0f9cb7b7a, f0a03dbe4db641e5ac1c5f39a658f681; no voters:
I20260810 14:52:26.536501 17835 leader_election.cc:302] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 370ccaaeb6294f61b7c8bc1ea43d30eb; no voters: 1115b2e59ee44ae4842ad3f0f9cb7b7a, f0a03dbe4db641e5ac1c5f39a658f681
I20260810 14:52:26.536612 18517 raft_consensus.cc:2726] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260810 14:52:26.536733 18529 raft_consensus.cc:2781] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:26.536713 18521 leader_election.cc:288] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [CANDIDATE]: Term 1 election: Requested vote from peers 370ccaaeb6294f61b7c8bc1ea43d30eb (127.19.29.193:41653), 1115b2e59ee44ae4842ad3f0f9cb7b7a (127.19.29.195:34725)
I20260810 14:52:26.536881 18529 raft_consensus.cc:686] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 LEADER]: Becoming Leader. State: Replica: f0a03dbe4db641e5ac1c5f39a658f681, State: Running, Role: LEADER
I20260810 14:52:26.536976 18529 consensus_queue.cc:237] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } }
I20260810 14:52:26.537799 17691 catalog_manager.cc:5495] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 reported cstate change: term changed from 0 to 1, leader changed from <none> to f0a03dbe4db641e5ac1c5f39a658f681 (127.19.29.194). New cstate: current_term: 1 leader_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0a03dbe4db641e5ac1c5f39a658f681" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 37091 } health_report { overall_health: HEALTHY } } }
I20260810 14:52:26.570448 18505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.568185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.19.29.194:37091)
0810 14:52:26.568249 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.568251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.568260 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:26.568301 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.568302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.568321 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.568381 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:26.568512 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.568971 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.569688 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.569872 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.569926 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.570102 (+ 176us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:26.570194 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:26.570276 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.570351 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.570358 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260810 14:52:26.572203 18404 raft_consensus.cc:1261] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 1 FOLLOWER]: Refusing update from remote peer f0a03dbe4db641e5ac1c5f39a658f681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:26.572227 17947 raft_consensus.cc:1261] T 1427768fb25043268a00b838e2bc18a1 P 370ccaaeb6294f61b7c8bc1ea43d30eb [term 1 FOLLOWER]: Refusing update from remote peer f0a03dbe4db641e5ac1c5f39a658f681: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:26.572535 18531 consensus_queue.cc:1035] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1115b2e59ee44ae4842ad3f0f9cb7b7a" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 34725 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:26.572669 18529 consensus_queue.cc:1035] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [LEADER]: Connected to new peer: Peer: permanent_uuid: "370ccaaeb6294f61b7c8bc1ea43d30eb" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:26.574968 18538 mvcc.cc:205] Tried to move back new op lower bound from 7316986046757097472 to 7316986046616027136. Current Snapshot: MvccSnapshot[applied={T|T < 7316986046757097472}]
I20260810 14:52:26.575038 18539 mvcc.cc:205] Tried to move back new op lower bound from 7316986046757097472 to 7316986046616027136. Current Snapshot: MvccSnapshot[applied={T|T < 7316986046757097472}]
I20260810 14:52:26.577327 17691 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:26.577428 17691 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54492:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:26.578151 17691 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ca7967f06c2044cebc7d231a1c26b745: Sending DeleteTablet for 3 replicas of tablet 1427768fb25043268a00b838e2bc18a1
I20260810 14:52:26.578476 18372 tablet_service.cc:1514] Processing DeleteTablet for tablet 1427768fb25043268a00b838e2bc18a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:26 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:46692
I20260810 14:52:26.578574 17908 tablet_service.cc:1514] Processing DeleteTablet for tablet 1427768fb25043268a00b838e2bc18a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:26 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:53346
I20260810 14:52:26.578717 18152 tablet_service.cc:1514] Processing DeleteTablet for tablet 1427768fb25043268a00b838e2bc18a1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:26 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:43474
I20260810 14:52:26.578816 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 17802
I20260810 14:52:26.612818 18550 tablet_replica.cc:330] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: stopping tablet replica
I20260810 14:52:26.613040 18550 raft_consensus.cc:2229] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:26.613242 18550 raft_consensus.cc:2258] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:26.615442 18550 ts_tablet_manager.cc:1905] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:26.617741 18550 ts_tablet_manager.cc:1918] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:26.617874 18550 log.cc:1196] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/1427768fb25043268a00b838e2bc18a1
I20260810 14:52:26.618494 18550 ts_tablet_manager.cc:1939] T 1427768fb25043268a00b838e2bc18a1 P 1115b2e59ee44ae4842ad3f0f9cb7b7a: Deleting consensus metadata
I20260810 14:52:26.619491 17668 catalog_manager.cc:4841] TS 1115b2e59ee44ae4842ad3f0f9cb7b7a (127.19.29.195:34725): tablet 1427768fb25043268a00b838e2bc18a1 (table test-table [id=263c7cba7b4149c6b5c5012978d42e24]) successfully deleted
I20260810 14:52:26.622944 18553 tablet_replica.cc:330] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: stopping tablet replica
I20260810 14:52:26.623098 18553 raft_consensus.cc:2229] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:52:26.623217 18553 raft_consensus.cc:2258] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:26.623771 18553 ts_tablet_manager.cc:1905] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:26.625103 18553 ts_tablet_manager.cc:1918] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:26.625173 18553 log.cc:1196] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/1427768fb25043268a00b838e2bc18a1
I20260810 14:52:26.625460 18553 ts_tablet_manager.cc:1939] T 1427768fb25043268a00b838e2bc18a1 P f0a03dbe4db641e5ac1c5f39a658f681: Deleting consensus metadata
I20260810 14:52:26.625864 17666 catalog_manager.cc:4841] TS f0a03dbe4db641e5ac1c5f39a658f681 (127.19.29.194:37091): tablet 1427768fb25043268a00b838e2bc18a1 (table test-table [id=263c7cba7b4149c6b5c5012978d42e24]) successfully deleted
W20260810 14:52:26.627995 17665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:41653 (error 108)
I20260810 14:52:26.628255 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 18043
I20260810 14:52:26.630007 18502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.628377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:41653 (local address 127.0.0.1:53348)
0810 14:52:26.629923 (+ 1546us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.629970 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1522}
W20260810 14:52:26.630147 17665 catalog_manager.cc:4584] TS 370ccaaeb6294f61b7c8bc1ea43d30eb (127.19.29.193:41653): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1427768fb25043268a00b838e2bc18a1: Network error: Client connection negotiation failed: client connection to 127.19.29.193:41653: connect: Connection refused (error 111)
I20260810 14:52:26.636849 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 18269
I20260810 14:52:26.647022 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 17634
2026-08-10T14:52:26Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2360 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-10T14:52:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:26Z Disabled control of system clock
I20260810 14:52:26.681198 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36671
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:26.760057 18563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:26.760262 18563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:26.760280 18563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:26.761412 18563 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:26.761456 18563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:26.761466 18563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:26.761478 18563 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:26.761498 18563 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:26.762876 18563 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36671
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18563
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:26.763106 18563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:26.763378 18563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:26.767951 18572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:26.767958 18578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:26.768055 18563 server_base.cc:1034] running on GCE node
W20260810 14:52:26.767957 18573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:26.768404 18563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:26.768646 18563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:26.769778 18563 hybrid_clock.cc:648] HybridClock initialized: now 1786373546769767 us; error 30 us; skew 500 ppm
I20260810 14:52:26.775641 18563 webserver.cc:460] Webserver started at http://127.19.29.254:36329/ using document root <none> and password file <none>
I20260810 14:52:26.775846 18563 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:26.775890 18563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:26.776017 18563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:26.777011 18563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "22515055d6374db098541cc78e873830"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "fc661ed4d9988779b98b4d9fb1c9c11e"
server_key_iv: "0047a4d8c67f30aa3f53d8a8d282b5db"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.777355 18563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "22515055d6374db098541cc78e873830"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "fc661ed4d9988779b98b4d9fb1c9c11e"
server_key_iv: "0047a4d8c67f30aa3f53d8a8d282b5db"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.778539 18563 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:26.779182 18589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.779330 18563 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:26.779412 18563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "22515055d6374db098541cc78e873830"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "fc661ed4d9988779b98b4d9fb1c9c11e"
server_key_iv: "0047a4d8c67f30aa3f53d8a8d282b5db"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.779469 18563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:26.798938 18563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:26.799202 18563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:26.799321 18563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:26.803049 18563 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36671
I20260810 14:52:26.803076 18674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36671 every 8 connection(s)
I20260810 14:52:26.803369 18563 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:26.804286 18677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:26.805327 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 18563
I20260810 14:52:26.805423 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:26.805583 19575 external_mini_cluster.cc:1428] Setting key d64c34fef3b2ad5393a167b59be3eb34
I20260810 14:52:26.806985 18677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: Bootstrap starting.
I20260810 14:52:26.807713 18677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:26.808029 18677 log.cc:824] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:26.808745 18677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: No bootstrap required, opened a new log
I20260810 14:52:26.810894 18677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } }
I20260810 14:52:26.811065 18677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:26.811105 18677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22515055d6374db098541cc78e873830, State: Initialized, Role: FOLLOWER
I20260810 14:52:26.811244 18677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } }
I20260810 14:52:26.811331 18677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:26.811374 18677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:26.811420 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.806054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50894 (local address 127.19.29.254:36671)
0810 14:52:26.806270 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.806279 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.806340 (+ 61us) server_negotiation.cc:407] Connection header received
0810 14:52:26.806826 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.806836 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.806914 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.807069 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:26.807304 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.808518 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.809309 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.809942 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.810074 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.810656 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:26.810661 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:26.810661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:26.810863 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:26.810905 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:26.810920 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:26.810987 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.811047 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.811222 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260810 14:52:26.811432 18677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:26.812093 18677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } }
I20260810 14:52:26.812184 18677 leader_election.cc:302] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22515055d6374db098541cc78e873830; no voters:
I20260810 14:52:26.812323 18677 leader_election.cc:288] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:26.812372 18685 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:26.812505 18685 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [term 1 LEADER]: Becoming Leader. State: Replica: 22515055d6374db098541cc78e873830, State: Running, Role: LEADER
I20260810 14:52:26.812544 18677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:26.812611 18685 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } }
I20260810 14:52:26.812954 18686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22515055d6374db098541cc78e873830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } } }
I20260810 14:52:26.813061 18686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:26.812960 18687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22515055d6374db098541cc78e873830. Latest consensus state: current_term: 1 leader_uuid: "22515055d6374db098541cc78e873830" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22515055d6374db098541cc78e873830" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36671 } } }
I20260810 14:52:26.813266 18687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:26.813448 18703 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:26.813884 18703 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:26.815209 18703 catalog_manager.cc:1347] Generated new cluster ID: 117d40b27f124df2a356475947ad4b80
I20260810 14:52:26.815260 18703 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:26.840032 18703 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:26.840528 18703 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:26.845271 18703 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: Generated new TSK 0
I20260810 14:52:26.845417 18703 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:26.849138 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--builtin_ntp_servers=127.19.29.212:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:26.929651 18723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:26.929841 18723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:26.929862 18723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:26.930992 18723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:26.931030 18723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:26.931053 18723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:26.932390 18723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:26.932623 18723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:26.932893 18723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:26.937891 18732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:26.937885 18723 server_base.cc:1034] running on GCE node
W20260810 14:52:26.937919 18731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:26.937909 18740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:26.938236 18723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:26.938494 18723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:26.939643 18723 hybrid_clock.cc:648] HybridClock initialized: now 1786373546939631 us; error 32 us; skew 500 ppm
I20260810 14:52:26.940768 18723 webserver.cc:460] Webserver started at http://127.19.29.193:39181/ using document root <none> and password file <none>
I20260810 14:52:26.940986 18723 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:26.941033 18723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:26.941160 18723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:26.942200 18723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "e07dc43435c545fdba48eb3352e97bac"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "93a9aaf62073a1090fa3a4002ddf457c"
server_key_iv: "e54ba9d0de777166edd27e7101f70842"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.942567 18723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "e07dc43435c545fdba48eb3352e97bac"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "93a9aaf62073a1090fa3a4002ddf457c"
server_key_iv: "e54ba9d0de777166edd27e7101f70842"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.943717 18723 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:26.944367 18748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.944552 18723 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:26.944638 18723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "e07dc43435c545fdba48eb3352e97bac"
format_stamp: "Formatted at 2026-08-10 14:52:26 on dist-test-slave-4tdj"
server_key: "93a9aaf62073a1090fa3a4002ddf457c"
server_key_iv: "e54ba9d0de777166edd27e7101f70842"
server_key_version: "encryptionkey@0"
I20260810 14:52:26.944702 18723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:26.965400 18723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:26.965684 18723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:26.965804 18723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:26.966013 18723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:26.966395 18723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:26.966442 18723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.966472 18723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:26.966495 18723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:26.972106 18723 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:43107
I20260810 14:52:26.972152 18962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:43107 every 8 connection(s)
I20260810 14:52:26.972453 18723 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:52:26.974334 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 18723
I20260810 14:52:26.974433 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:26.974642 19575 external_mini_cluster.cc:1428] Setting key b98380dc0a598b2325898e2a07f56f56
I20260810 14:52:26.975574 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--builtin_ntp_servers=127.19.29.212:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:52:26.977883 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.973132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48477 (local address 127.19.29.254:36671)
0810 14:52:26.973194 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:26.973196 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:26.973412 (+ 216us) server_negotiation.cc:407] Connection header received
0810 14:52:26.973876 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:26.973877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:26.973887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:26.973945 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:26.974672 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.975348 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.976413 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.976663 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.976734 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.977459 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:26.977460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:26.977460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:26.977465 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:26.977480 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:26.977484 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:26.977529 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:26.977779 (+ 250us) server_negotiation.cc:299] Negotiation successful
0810 14:52:26.977803 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:52:26.978052 18972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:26.973100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36671 (local address 127.19.29.193:48477)
0810 14:52:26.973288 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:26.973328 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:26.973797 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:26.973997 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:26.974001 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:26.974008 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:26.974584 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.974589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.975433 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.975434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.976332 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:26.976335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:26.976733 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:26.976734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:26.976834 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:26.977324 (+ 490us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:26.977324 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:26.977352 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:26.977375 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:26.977536 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:26.977541 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:26.977544 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:26.977606 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:52:26.977829 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":104,"threads_started":1}
I20260810 14:52:26.978525 18966 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36671
I20260810 14:52:26.978631 18966 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:26.978817 18966 heartbeater.cc:511] Master 127.19.29.254:36671 requested a full tablet report, sending...
I20260810 14:52:26.979324 18622 ts_manager.cc:194] Registered new tserver with Master: e07dc43435c545fdba48eb3352e97bac (127.19.29.193:43107)
I20260810 14:52:26.979910 18622 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.193:48477
W20260810 14:52:27.060283 18974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:27.060498 18974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:27.060523 18974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:27.061672 18974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:27.061720 18974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:27.061745 18974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:27.063109 18974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18974
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:27.063344 18974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:27.063644 18974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:27.068790 18985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:27.068776 18988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:27.068775 18983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:27.068804 18974 server_base.cc:1034] running on GCE node
I20260810 14:52:27.069201 18974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:27.069439 18974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:27.070585 18974 hybrid_clock.cc:648] HybridClock initialized: now 1786373547070561 us; error 34 us; skew 500 ppm
I20260810 14:52:27.071791 18974 webserver.cc:460] Webserver started at http://127.19.29.194:40431/ using document root <none> and password file <none>
I20260810 14:52:27.072003 18974 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:27.072052 18974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:27.072190 18974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:27.073206 18974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "70f4170d62a3424a91547f1eabee1f76"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "1909cb4cd23b0c79bc4ea179f52da4a8"
server_key_iv: "e899498ba68f66b242f662ab8d55edc9"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.073541 18974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "70f4170d62a3424a91547f1eabee1f76"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "1909cb4cd23b0c79bc4ea179f52da4a8"
server_key_iv: "e899498ba68f66b242f662ab8d55edc9"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.075054 18974 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:27.075752 18999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.075904 18974 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:27.075994 18974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "70f4170d62a3424a91547f1eabee1f76"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "1909cb4cd23b0c79bc4ea179f52da4a8"
server_key_iv: "e899498ba68f66b242f662ab8d55edc9"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.076054 18974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:27.086133 18974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:27.086401 18974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:27.086504 18974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:27.086681 18974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:27.086928 18974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:27.086956 18974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.086983 18974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:27.086998 18974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.092768 18974 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:45695
I20260810 14:52:27.092803 19198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:45695 every 8 connection(s)
I20260810 14:52:27.093117 18974 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:27.098110 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.093830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:45053 (local address 127.19.29.254:36671)
0810 14:52:27.093893 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.093895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.094099 (+ 204us) server_negotiation.cc:407] Connection header received
0810 14:52:27.094672 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.094673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.094687 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.094733 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:27.095377 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.095875 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.096822 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.097035 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.097090 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.097845 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:27.097846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:27.097847 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:27.097852 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:27.097867 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:27.097871 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:27.097917 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.097998 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.098032 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260810 14:52:27.098315 19202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.093792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36671 (local address 127.19.29.194:45053)
0810 14:52:27.093985 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.094018 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.094570 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.094811 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.094814 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.094822 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:27.095282 (+ 460us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.095287 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.095963 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.095964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.096730 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.096732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.097110 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.097111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.097228 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.097706 (+ 478us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:27.097707 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:27.097735 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:27.097758 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:27.097923 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:27.097928 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:27.097932 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.097993 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.098093 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260810 14:52:27.098827 19200 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36671
I20260810 14:52:27.098904 19200 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:27.099080 19200 heartbeater.cc:511] Master 127.19.29.254:36671 requested a full tablet report, sending...
I20260810 14:52:27.099428 18622 ts_manager.cc:194] Registered new tserver with Master: 70f4170d62a3424a91547f1eabee1f76 (127.19.29.194:45695)
I20260810 14:52:27.099768 18622 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.194:45053
I20260810 14:52:27.101547 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 18974
I20260810 14:52:27.101644 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:27.101797 19575 external_mini_cluster.cc:1428] Setting key 3323e166f811265396648b53df078e82
I20260810 14:52:27.102653 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--builtin_ntp_servers=127.19.29.212:37891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:27.182663 19203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:27.182852 19203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:27.182880 19203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:27.183974 19203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:27.184011 19203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:27.184043 19203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:27.185375 19203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:37891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:36671
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:27.185602 19203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:27.185868 19203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:27.190659 19219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:27.190678 19212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:27.190726 19216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:27.190706 19203 server_base.cc:1034] running on GCE node
I20260810 14:52:27.191075 19203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:27.191301 19203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:27.192435 19203 hybrid_clock.cc:648] HybridClock initialized: now 1786373547192421 us; error 29 us; skew 500 ppm
I20260810 14:52:27.193600 19203 webserver.cc:460] Webserver started at http://127.19.29.195:41167/ using document root <none> and password file <none>
I20260810 14:52:27.193809 19203 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:27.193852 19203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:27.193976 19203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:27.195091 19203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "f99969e6291e4d6b9d138ba5dd3a2342"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "56980e08667fbccc38148cec4d90a811"
server_key_iv: "b89c955c1b27c01265435d424c57519e"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.195421 19203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "f99969e6291e4d6b9d138ba5dd3a2342"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "56980e08667fbccc38148cec4d90a811"
server_key_iv: "b89c955c1b27c01265435d424c57519e"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.196622 19203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:52:27.197271 19226 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.197407 19203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:27.197497 19203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "f99969e6291e4d6b9d138ba5dd3a2342"
format_stamp: "Formatted at 2026-08-10 14:52:27 on dist-test-slave-4tdj"
server_key: "56980e08667fbccc38148cec4d90a811"
server_key_iv: "b89c955c1b27c01265435d424c57519e"
server_key_version: "encryptionkey@0"
I20260810 14:52:27.197564 19203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:27.220094 19203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:27.220387 19203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:27.220513 19203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:27.220737 19203 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:27.221072 19203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:27.221107 19203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.221129 19203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:27.221153 19203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:27.226606 19203 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:45543
I20260810 14:52:27.226660 19403 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:45543 every 8 connection(s)
I20260810 14:52:27.226966 19203 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:27.227864 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19203
I20260810 14:52:27.227952 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:27.228140 19575 external_mini_cluster.cc:1428] Setting key 7cb224224c5596e6123ea6c667ba823b
I20260810 14:52:27.232053 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.227678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:42231 (local address 127.19.29.254:36671)
0810 14:52:27.227748 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.227751 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.227954 (+ 203us) server_negotiation.cc:407] Connection header received
0810 14:52:27.228572 (+ 618us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.228573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.228584 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.228629 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:27.229299 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.229779 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.230786 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.230971 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.231033 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.231789 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:27.231790 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:27.231791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:27.231795 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:27.231810 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:27.231815 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:27.231856 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.231938 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.231964 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260810 14:52:27.232244 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.227624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:36671 (local address 127.19.29.195:42231)
0810 14:52:27.227822 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.227864 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.228436 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.228703 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.228707 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.228717 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:27.229207 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.229211 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.229862 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.229863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.230702 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.230704 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.231047 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.231049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.231180 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.231657 (+ 477us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:27.231657 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:27.231687 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:27.231709 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:27.231863 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:27.231868 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:27.231871 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.231937 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.232045 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":91,"threads_started":1}
I20260810 14:52:27.232636 19404 heartbeater.cc:347] Connected to a master server at 127.19.29.254:36671
I20260810 14:52:27.232719 19404 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:27.232868 19404 heartbeater.cc:511] Master 127.19.29.254:36671 requested a full tablet report, sending...
I20260810 14:52:27.233187 18622 ts_manager.cc:194] Registered new tserver with Master: f99969e6291e4d6b9d138ba5dd3a2342 (127.19.29.195:45543)
I20260810 14:52:27.233538 18622 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.195:42231
I20260810 14:52:27.239630 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:27.243598 18682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.240949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50900 (local address 127.19.29.254:36671)
0810 14:52:27.240999 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.241000 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.241119 (+ 119us) server_negotiation.cc:407] Connection header received
0810 14:52:27.241175 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.241176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.241183 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.241228 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:27.241360 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.241808 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.242589 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.242761 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.242807 (+ 46us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.243373 (+ 566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:27.243374 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:27.243374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:27.243378 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:27.243389 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:27.243393 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:27.243462 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.243522 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.243532 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:52:27.245052 18622 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:27.246637 18622 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:27.252599 19416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.248671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:45543 (local address 127.0.0.1:47348)
0810 14:52:27.248819 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.248857 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.248920 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.249408 (+ 488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.249408 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.249410 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:27.249474 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.249476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250450 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.250451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.251627 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.251630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252329 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.252406 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252420 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.252481 (+ 61us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.252528 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"mutex_wait_us":2,"thread_start_us":45,"threads_started":1}
I20260810 14:52:27.252614 19420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.248737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47348 (local address 127.19.29.195:45543)
0810 14:52:27.249247 (+ 510us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.249252 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.249262 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:27.249297 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.249299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.249313 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.249546 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:27.249596 (+ 50us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250370 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.251719 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252246 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252309 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252394 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.252492 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.252527 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":475,"thread_start_us":67,"threads_started":1}
I20260810 14:52:27.252764 19422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.248900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45695 (local address 127.0.0.1:52320)
0810 14:52:27.249181 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.249192 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.249255 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.249496 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.249497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.249499 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:27.249552 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.249554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250791 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.250791 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.251572 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.251575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252548 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252549 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.252606 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252611 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.252656 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.252693 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":64,"threads_started":1}
I20260810 14:52:27.252887 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.248709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43107 (local address 127.0.0.1:51882)
0810 14:52:27.248840 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.248858 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.248920 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.249397 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.249401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.249403 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:27.249474 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.249477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250761 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.250762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.251792 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.251794 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252653 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.252706 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252708 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.252736 (+ 28us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.252766 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260810 14:52:27.253069 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.249004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52320 (local address 127.19.29.194:45695)
0810 14:52:27.249178 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.249182 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.249243 (+ 61us) server_negotiation.cc:407] Connection header received
0810 14:52:27.249351 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.249353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.249368 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.249431 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:27.249632 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250734 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.251655 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252356 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252424 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252508 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.252942 (+ 434us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.252982 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260810 14:52:27.253062 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.249032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51882 (local address 127.19.29.193:43107)
0810 14:52:27.249216 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.249220 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.249229 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:27.249268 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.249270 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.249286 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.249360 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:27.249546 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.250674 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.251866 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.252567 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.252807 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.252918 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.252941 (+ 23us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.252982 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":95,"threads_started":1}
I20260810 14:52:27.253712 19087 tablet_service.cc:1467] Processing CreateTablet for tablet f750431a508f41fd84aa599b7e14c5a5 (DEFAULT_TABLE table=test-table [id=209dd12def204a0fa2ad817fcf7633a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:27.253901 18838 tablet_service.cc:1467] Processing CreateTablet for tablet f750431a508f41fd84aa599b7e14c5a5 (DEFAULT_TABLE table=test-table [id=209dd12def204a0fa2ad817fcf7633a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:27.254112 19087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750431a508f41fd84aa599b7e14c5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:27.254202 18838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750431a508f41fd84aa599b7e14c5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:27.254617 19306 tablet_service.cc:1467] Processing CreateTablet for tablet f750431a508f41fd84aa599b7e14c5a5 (DEFAULT_TABLE table=test-table [id=209dd12def204a0fa2ad817fcf7633a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:27.254889 19306 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750431a508f41fd84aa599b7e14c5a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:27.257160 19429 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Bootstrap starting.
I20260810 14:52:27.257516 19431 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Bootstrap starting.
I20260810 14:52:27.257581 19430 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Bootstrap starting.
I20260810 14:52:27.257936 19429 tablet_bootstrap.cc:654] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:27.258179 19430 tablet_bootstrap.cc:654] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:27.258179 19431 tablet_bootstrap.cc:654] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:27.258201 19429 log.cc:824] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:27.258523 19431 log.cc:824] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:27.258534 19430 log.cc:824] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:27.258958 19429 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: No bootstrap required, opened a new log
I20260810 14:52:27.259034 19429 ts_tablet_manager.cc:1397] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:27.259245 19430 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: No bootstrap required, opened a new log
I20260810 14:52:27.259317 19430 ts_tablet_manager.cc:1397] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:52:27.259487 19431 tablet_bootstrap.cc:492] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: No bootstrap required, opened a new log
I20260810 14:52:27.259552 19431 ts_tablet_manager.cc:1397] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260810 14:52:27.261049 19429 raft_consensus.cc:348] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.261180 19429 raft_consensus.cc:374] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:27.261212 19429 raft_consensus.cc:729] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f99969e6291e4d6b9d138ba5dd3a2342, State: Initialized, Role: FOLLOWER
I20260810 14:52:27.261323 19429 consensus_queue.cc:260] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.261581 19429 ts_tablet_manager.cc:1428] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:52:27.261713 19404 heartbeater.cc:503] Master 127.19.29.254:36671 was elected leader, sending a full tablet report...
I20260810 14:52:27.261888 19431 raft_consensus.cc:348] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.262048 19431 raft_consensus.cc:374] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:27.262091 19431 raft_consensus.cc:729] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70f4170d62a3424a91547f1eabee1f76, State: Initialized, Role: FOLLOWER
I20260810 14:52:27.262149 19430 raft_consensus.cc:348] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.262213 19431 consensus_queue.cc:260] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.262310 19430 raft_consensus.cc:374] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:27.262359 19430 raft_consensus.cc:729] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07dc43435c545fdba48eb3352e97bac, State: Initialized, Role: FOLLOWER
I20260810 14:52:27.262480 19431 ts_tablet_manager.cc:1428] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 14:52:27.262591 19200 heartbeater.cc:503] Master 127.19.29.254:36671 was elected leader, sending a full tablet report...
I20260810 14:52:27.262485 19430 consensus_queue.cc:260] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.262828 19430 ts_tablet_manager.cc:1428] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260810 14:52:27.262864 18966 heartbeater.cc:503] Master 127.19.29.254:36671 was elected leader, sending a full tablet report...
W20260810 14:52:27.343643 19201 tablet.cc:2369] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:27.440985 19438 raft_consensus.cc:482] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:27.441123 19438 raft_consensus.cc:504] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.441502 19438 leader_election.cc:288] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e07dc43435c545fdba48eb3352e97bac (127.19.29.193:43107), 70f4170d62a3424a91547f1eabee1f76 (127.19.29.194:45695)
I20260810 14:52:27.444375 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.441791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:50205 (local address 127.19.29.193:43107)
0810 14:52:27.441862 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.441864 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.441874 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:27.441905 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.441906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.441918 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.441974 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:27.442139 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.442669 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.443700 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.444060 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.444122 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.444130 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.444273 (+ 143us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.444309 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260810 14:52:27.444377 19407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.441706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43107 (local address 127.19.29.195:50205)
0810 14:52:27.441767 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.441779 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.441835 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.441996 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.441998 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.442000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:27.442071 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.442072 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.442746 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.442747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.443612 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.443614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.444130 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.444130 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.444206 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.444210 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.444262 (+ 52us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.444303 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":40}
I20260810 14:52:27.444394 19423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.441905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:33511 (local address 127.19.29.194:45695)
0810 14:52:27.441962 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.441964 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.442061 (+ 97us) server_negotiation.cc:407] Connection header received
0810 14:52:27.442111 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.442112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.442121 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.442168 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:27.442322 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.442792 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.443713 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.444062 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.444121 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.444129 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.444287 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.444327 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:52:27.444491 19441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.441809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45695 (local address 127.19.29.195:33511)
0810 14:52:27.441988 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.442007 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:27.442058 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:27.442178 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:27.442178 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:27.442180 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:27.442250 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.442252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.442863 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.442864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.443634 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:27.443636 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.444131 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.444133 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:27.444227 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.444230 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:27.444275 (+ 45us) client_negotiation.cc:240] Negotiation successful
0810 14:52:27.444419 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":16,"thread_start_us":120,"threads_started":1}
I20260810 14:52:27.444718 18878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750431a508f41fd84aa599b7e14c5a5" candidate_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07dc43435c545fdba48eb3352e97bac" is_pre_election: true
I20260810 14:52:27.444782 19119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750431a508f41fd84aa599b7e14c5a5" candidate_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f4170d62a3424a91547f1eabee1f76" is_pre_election: true
I20260810 14:52:27.444864 18878 raft_consensus.cc:2454] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99969e6291e4d6b9d138ba5dd3a2342 in term 0.
I20260810 14:52:27.444936 19119 raft_consensus.cc:2454] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f99969e6291e4d6b9d138ba5dd3a2342 in term 0.
I20260810 14:52:27.445091 19230 leader_election.cc:302] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e07dc43435c545fdba48eb3352e97bac, f99969e6291e4d6b9d138ba5dd3a2342; no voters:
I20260810 14:52:27.445247 19438 raft_consensus.cc:2781] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:27.445322 19438 raft_consensus.cc:482] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:27.445339 19438 raft_consensus.cc:3037] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:27.446056 19438 raft_consensus.cc:504] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.446167 19438 leader_election.cc:288] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [CANDIDATE]: Term 1 election: Requested vote from peers e07dc43435c545fdba48eb3352e97bac (127.19.29.193:43107), 70f4170d62a3424a91547f1eabee1f76 (127.19.29.194:45695)
I20260810 14:52:27.446336 18878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750431a508f41fd84aa599b7e14c5a5" candidate_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07dc43435c545fdba48eb3352e97bac"
I20260810 14:52:27.446360 19119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750431a508f41fd84aa599b7e14c5a5" candidate_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "70f4170d62a3424a91547f1eabee1f76"
I20260810 14:52:27.446410 18878 raft_consensus.cc:3037] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:27.446424 19119 raft_consensus.cc:3037] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:27.447129 19119 raft_consensus.cc:2454] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99969e6291e4d6b9d138ba5dd3a2342 in term 1.
I20260810 14:52:27.447271 18878 raft_consensus.cc:2454] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f99969e6291e4d6b9d138ba5dd3a2342 in term 1.
I20260810 14:52:27.447312 19230 leader_election.cc:302] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 70f4170d62a3424a91547f1eabee1f76, f99969e6291e4d6b9d138ba5dd3a2342; no voters:
I20260810 14:52:27.447433 19438 raft_consensus.cc:2781] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:27.447570 19438 raft_consensus.cc:686] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 1 LEADER]: Becoming Leader. State: Replica: f99969e6291e4d6b9d138ba5dd3a2342, State: Running, Role: LEADER
I20260810 14:52:27.447654 19438 consensus_queue.cc:237] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } }
I20260810 14:52:27.448515 18621 catalog_manager.cc:5495] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 reported cstate change: term changed from 0 to 1, leader changed from <none> to f99969e6291e4d6b9d138ba5dd3a2342 (127.19.29.195). New cstate: current_term: 1 leader_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f99969e6291e4d6b9d138ba5dd3a2342" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 45543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 } health_report { overall_health: UNKNOWN } } }
W20260810 14:52:27.473110 18968 tablet.cc:2369] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260810 14:52:27.477442 19405 tablet.cc:2369] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:27.480931 19420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.478878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.19.29.195:45543)
0810 14:52:27.478919 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:27.478921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:27.478929 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:27.478962 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:27.478963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:27.478981 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:27.479037 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:27.479155 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.479684 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.480348 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:27.480516 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:27.480578 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:27.480684 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:27.480766 (+ 82us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:27.480830 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:27.480860 (+ 30us) server_negotiation.cc:299] Negotiation successful
0810 14:52:27.480867 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:27.482591 18878 raft_consensus.cc:1261] T f750431a508f41fd84aa599b7e14c5a5 P e07dc43435c545fdba48eb3352e97bac [term 1 FOLLOWER]: Refusing update from remote peer f99969e6291e4d6b9d138ba5dd3a2342: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:27.482614 19119 raft_consensus.cc:1261] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 1 FOLLOWER]: Refusing update from remote peer f99969e6291e4d6b9d138ba5dd3a2342: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:27.482909 19443 consensus_queue.cc:1035] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07dc43435c545fdba48eb3352e97bac" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:27.483028 19438 consensus_queue.cc:1035] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [LEADER]: Connected to new peer: Peer: permanent_uuid: "70f4170d62a3424a91547f1eabee1f76" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 45695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:27.485296 19449 mvcc.cc:205] Tried to move back new op lower bound from 7316986050486247424 to 7316986050346233856. Current Snapshot: MvccSnapshot[applied={T|T < 7316986050486247424}]
I20260810 14:52:27.485460 19450 mvcc.cc:205] Tried to move back new op lower bound from 7316986050486247424 to 7316986050346233856. Current Snapshot: MvccSnapshot[applied={T|T < 7316986050486247424}]
I20260810 14:52:27.485862 19447 mvcc.cc:205] Tried to move back new op lower bound from 7316986050486247424 to 7316986050346233856. Current Snapshot: MvccSnapshot[applied={T|T < 7316986050486247424 or (T in {7316986050486247424})}]
I20260810 14:52:27.487412 18621 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:50900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:27.487499 18621 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:50900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:27.488184 18621 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22515055d6374db098541cc78e873830: Sending DeleteTablet for 3 replicas of tablet f750431a508f41fd84aa599b7e14c5a5
I20260810 14:52:27.488533 19306 tablet_service.cc:1514] Processing DeleteTablet for tablet f750431a508f41fd84aa599b7e14c5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:27 UTC) from {username='slave'} at 127.0.0.1:47348
I20260810 14:52:27.488538 19087 tablet_service.cc:1514] Processing DeleteTablet for tablet f750431a508f41fd84aa599b7e14c5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:27 UTC) from {username='slave'} at 127.0.0.1:52320
I20260810 14:52:27.488758 18838 tablet_service.cc:1514] Processing DeleteTablet for tablet f750431a508f41fd84aa599b7e14c5a5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:27 UTC) from {username='slave'} at 127.0.0.1:51882
I20260810 14:52:27.488833 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 18723
I20260810 14:52:27.488863 19461 tablet_replica.cc:330] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: stopping tablet replica
I20260810 14:52:27.489034 19461 raft_consensus.cc:2229] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:52:27.489249 19461 raft_consensus.cc:2258] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:27.491889 19461 ts_tablet_manager.cc:1905] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:27.494781 19461 ts_tablet_manager.cc:1918] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:27.494861 19461 log.cc:1196] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/f750431a508f41fd84aa599b7e14c5a5
I20260810 14:52:27.495148 19461 ts_tablet_manager.cc:1939] T f750431a508f41fd84aa599b7e14c5a5 P f99969e6291e4d6b9d138ba5dd3a2342: Deleting consensus metadata
I20260810 14:52:27.495553 18592 catalog_manager.cc:4841] TS f99969e6291e4d6b9d138ba5dd3a2342 (127.19.29.195:45543): tablet f750431a508f41fd84aa599b7e14c5a5 (table test-table [id=209dd12def204a0fa2ad817fcf7633a0]) successfully deleted
W20260810 14:52:27.498736 18594 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:43107 (error 108)
I20260810 14:52:27.498891 19464 tablet_replica.cc:330] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: stopping tablet replica
I20260810 14:52:27.499010 19464 raft_consensus.cc:2229] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:27.499127 19464 raft_consensus.cc:2258] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:27.499207 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.499097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43107 (local address 127.0.0.1:51886)
0810 14:52:27.499136 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.499177 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43107: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
W20260810 14:52:27.499301 18594 catalog_manager.cc:4584] TS e07dc43435c545fdba48eb3352e97bac (127.19.29.193:43107): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f750431a508f41fd84aa599b7e14c5a5: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43107: connect: Connection refused (error 111)
I20260810 14:52:27.499547 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 18974
I20260810 14:52:27.499573 19464 ts_tablet_manager.cc:1905] T f750431a508f41fd84aa599b7e14c5a5 P 70f4170d62a3424a91547f1eabee1f76: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:27.517355 19419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:27.517241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:45695 (local address 127.0.0.1:52336)
0810 14:52:27.517291 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:27.517319 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.194:45695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 14:52:27.517352 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19203
I20260810 14:52:27.528431 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 18563
2026-08-10T14:52:27Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (876 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:27 dist-test-slave-4tdj krb5kdc[19470](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:27 dist-test-slave-4tdj krb5kdc[19470](info): set up 2 sockets
Aug 10 14:52:27 dist-test-slave-4tdj krb5kdc[19470](info): commencing operation
krb5kdc: starting...
W20260810 14:52:28.679240 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:28 dist-test-slave-4tdj krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:28.792455 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45055
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45055
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:28.871788 19498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:28.871970 19498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:28.872004 19498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:28.873085 19498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:28.873122 19498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:28.873142 19498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:28.873157 19498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:28.873172 19498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:28.874593 19498 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45055
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:28.874816 19498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:28.875005 19498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:28.879454 19511 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:28.879467 19513 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:28.879484 19510 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:28.879722 19498 server_base.cc:1034] running on GCE node
I20260810 14:52:28.879945 19498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:28.880182 19498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:28.881311 19498 hybrid_clock.cc:648] HybridClock initialized: now 1786373548881293 us; error 32 us; skew 500 ppm
Aug 10 14:52:28 dist-test-slave-4tdj krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373548, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:28.883565 19498 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:28.883936 19498 webserver.cc:460] Webserver started at http://127.19.29.254:36995/ using document root <none> and password file <none>
I20260810 14:52:28.884137 19498 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:28.884183 19498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:28.884301 19498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:28.885257 19498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "68ab83b907a448979fb2ef0c919f5ab1"
format_stamp: "Formatted at 2026-08-10 14:52:28 on dist-test-slave-4tdj"
server_key: "78a171d91a201fc734411a6056128955"
server_key_iv: "95a105053d971480f1ac23a64675b87b"
server_key_version: "encryptionkey@0"
I20260810 14:52:28.885571 19498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "68ab83b907a448979fb2ef0c919f5ab1"
format_stamp: "Formatted at 2026-08-10 14:52:28 on dist-test-slave-4tdj"
server_key: "78a171d91a201fc734411a6056128955"
server_key_iv: "95a105053d971480f1ac23a64675b87b"
server_key_version: "encryptionkey@0"
I20260810 14:52:28.886780 19498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:28.887393 19522 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:28.887538 19498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:28.887609 19498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "68ab83b907a448979fb2ef0c919f5ab1"
format_stamp: "Formatted at 2026-08-10 14:52:28 on dist-test-slave-4tdj"
server_key: "78a171d91a201fc734411a6056128955"
server_key_iv: "95a105053d971480f1ac23a64675b87b"
server_key_version: "encryptionkey@0"
I20260810 14:52:28.887667 19498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:28.908362 19498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:28.910071 19498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:28.910209 19498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:28.913982 19498 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45055
I20260810 14:52:28.914026 19606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45055 every 8 connection(s)
I20260810 14:52:28.914366 19498 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:28.915239 19607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:28.916580 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19498
I20260810 14:52:28.916685 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:28.916844 19575 external_mini_cluster.cc:1428] Setting key 528b5bf3300a35ed1e6b304a7c38a37f
I20260810 14:52:28.917709 19607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: Bootstrap starting.
I20260810 14:52:28.918434 19607 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:28.918731 19607 log.cc:824] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:28.919332 19607 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: No bootstrap required, opened a new log
I20260810 14:52:28.921077 19607 raft_consensus.cc:348] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } }
I20260810 14:52:28.921206 19607 raft_consensus.cc:374] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:28.921243 19607 raft_consensus.cc:729] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ab83b907a448979fb2ef0c919f5ab1, State: Initialized, Role: FOLLOWER
I20260810 14:52:28.921363 19607 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } }
I20260810 14:52:28.921447 19607 raft_consensus.cc:388] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:28.921486 19607 raft_consensus.cc:482] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:28.921530 19607 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:28.922017 19607 raft_consensus.cc:504] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } }
I20260810 14:52:28.922114 19607 leader_election.cc:302] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68ab83b907a448979fb2ef0c919f5ab1; no voters:
I20260810 14:52:28.922258 19607 leader_election.cc:288] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:28.922312 19620 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:28.922467 19620 raft_consensus.cc:686] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [term 1 LEADER]: Becoming Leader. State: Replica: 68ab83b907a448979fb2ef0c919f5ab1, State: Running, Role: LEADER
I20260810 14:52:28.922533 19607 sys_catalog.cc:564] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:28.922644 19620 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } }
Aug 10 14:52:28 dist-test-slave-4tdj krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:28.922981 19620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68ab83b907a448979fb2ef0c919f5ab1. Latest consensus state: current_term: 1 leader_uuid: "68ab83b907a448979fb2ef0c919f5ab1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } } }
I20260810 14:52:28.923048 19620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:28.923067 19622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68ab83b907a448979fb2ef0c919f5ab1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ab83b907a448979fb2ef0c919f5ab1" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45055 } } }
I20260810 14:52:28.923147 19622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:28.923229 19631 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:28.923732 19631 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:28.925595 19631 catalog_manager.cc:1347] Generated new cluster ID: 06d2c0a26e9c4239a0675b417c45416c
I20260810 14:52:28.925648 19631 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:28.926903 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:28.917371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.19.29.254:45055)
0810 14:52:28.917574 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:28.917584 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:28.917616 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:52:28.918134 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:28.918143 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:28.918205 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:28.918381 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:28.918968 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:28.919873 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:28.920555 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:28.920936 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:28.921036 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:28.923576 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:28.923580 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:28.923581 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:28.923592 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:28.925456 (+ 1864us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:28.925831 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:28.925835 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:28.925835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:28.925918 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:28.926094 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:28.926095 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:28.926095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:28.926374 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:28.926506 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:28.926609 (+ 103us) server_negotiation.cc:299] Negotiation successful
0810 14:52:28.926734 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
I20260810 14:52:28.932569 19631 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:28.933034 19631 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:28.937112 19631 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: Generated new TSK 0
I20260810 14:52:28.937258 19631 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.19.29.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
Entry for principal kudu/127.19.29.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab.
I20260810 14:52:28.966706 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:29.066169 19652 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.066448 19652 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.066476 19652 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.067617 19652 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.067656 19652 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.067682 19652 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:29.069136 19652 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.193.keytab
--principal=kudu/127.19.29.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19652
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.069353 19652 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.069561 19652 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.075383 19665 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.075368 19664 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.075368 19668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.075577 19652 server_base.cc:1034] running on GCE node
I20260810 14:52:29.075837 19652 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.076061 19652 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.077232 19652 hybrid_clock.cc:648] HybridClock initialized: now 1786373549077217 us; error 32 us; skew 500 ppm
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:29.079672 19652 init.cc:377] Logged in from keytab as kudu/127.19.29.193@KRBTEST.COM (short username kudu)
I20260810 14:52:29.080111 19652 webserver.cc:460] Webserver started at http://127.19.29.193:33315/ using document root <none> and password file <none>
I20260810 14:52:29.080304 19652 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.080353 19652 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.080475 19652 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.081550 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "9a593133889d48b58cdb855bfb02d4e1"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "1c4b69b3137ae31803889c06b1af6605"
server_key_iv: "881f54f4901e31a11997cf9102e1a7a0"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.081910 19652 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "9a593133889d48b58cdb855bfb02d4e1"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "1c4b69b3137ae31803889c06b1af6605"
server_key_iv: "881f54f4901e31a11997cf9102e1a7a0"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.083262 19652 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:29.084050 19683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.084260 19652 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:29.084345 19652 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "9a593133889d48b58cdb855bfb02d4e1"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "1c4b69b3137ae31803889c06b1af6605"
server_key_iv: "881f54f4901e31a11997cf9102e1a7a0"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.084416 19652 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:29.108640 19652 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:29.110481 19652 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:29.110613 19652 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:29.110838 19652 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:29.111145 19652 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:29.111179 19652 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.111207 19652 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:29.111224 19652 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.116808 19652 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:43739
I20260810 14:52:29.116852 19870 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:43739 every 8 connection(s)
I20260810 14:52:29.117163 19652 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:52:29.122120 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19652
I20260810 14:52:29.122219 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:29.122409 19575 external_mini_cluster.cc:1428] Setting key 366143993950c93229a2b62c9b854c2f
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.193@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:29.126827 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.117844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:48283 (local address 127.19.29.254:45055)
0810 14:52:29.117885 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.117887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.118086 (+ 199us) server_negotiation.cc:407] Connection header received
0810 14:52:29.118619 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.118620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.118632 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.118687 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.119563 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.120085 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.121093 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.121313 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.121365 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.123545 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.123546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.123547 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:29.123555 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.125226 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.125757 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.125758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.125759 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.125817 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.126118 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.126119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.126119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.126239 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.126324 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.126678 (+ 354us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.126760 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:52:29.126989 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.117822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45055 (local address 127.19.29.193:48283)
0810 14:52:29.117966 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.118002 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.118505 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.118743 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.118746 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.119291 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:29.119477 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.119481 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.120194 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.120195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.121010 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.121013 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.121390 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.121391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.121494 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.121942 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:29.121950 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:29.123465 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:29.125319 (+ 1854us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.125328 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.125330 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.125663 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.125877 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.125878 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.125879 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.126019 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.126331 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:29.126339 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:29.126499 (+ 160us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.126623 (+ 124us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.126781 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":76,"threads_started":1}
I20260810 14:52:29.127604 19871 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45055
I20260810 14:52:29.127712 19871 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:29.127911 19871 heartbeater.cc:511] Master 127.19.29.254:45055 requested a full tablet report, sending...
I20260810 14:52:29.128391 19547 ts_manager.cc:194] Registered new tserver with Master: 9a593133889d48b58cdb855bfb02d4e1 (127.19.29.193:43739)
I20260810 14:52:29.128966 19547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.193@KRBTEST.COM'} at 127.19.29.193:48283
WARNING: no policy specified for kudu/127.19.29.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
Entry for principal kudu/127.19.29.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab.
I20260810 14:52:29.147128 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:29.229602 19879 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.229802 19879 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.229836 19879 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.231007 19879 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.231053 19879 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.231091 19879 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:29.232622 19879 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.194.keytab
--principal=kudu/127.19.29.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19879
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.232860 19879 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.233071 19879 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.237977 19890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.238003 19889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.238025 19879 server_base.cc:1034] running on GCE node
W20260810 14:52:29.238063 19892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.238380 19879 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.238612 19879 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.239748 19879 hybrid_clock.cc:648] HybridClock initialized: now 1786373549239736 us; error 29 us; skew 500 ppm
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:29.242076 19879 init.cc:377] Logged in from keytab as kudu/127.19.29.194@KRBTEST.COM (short username kudu)
I20260810 14:52:29.242496 19879 webserver.cc:460] Webserver started at http://127.19.29.194:32979/ using document root <none> and password file <none>
I20260810 14:52:29.242709 19879 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.242755 19879 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.242877 19879 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.243845 19879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "9de95a44f8e84c45969b93a3ec5db83a"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "ada708ddf0d8197a9b602db62aa66607"
server_key_iv: "d0749e8b3997e1054c1e2e1595d560a5"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.244168 19879 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "9de95a44f8e84c45969b93a3ec5db83a"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "ada708ddf0d8197a9b602db62aa66607"
server_key_iv: "d0749e8b3997e1054c1e2e1595d560a5"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.245371 19879 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:29.246074 19904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.246243 19879 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:29.246344 19879 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "9de95a44f8e84c45969b93a3ec5db83a"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "ada708ddf0d8197a9b602db62aa66607"
server_key_iv: "d0749e8b3997e1054c1e2e1595d560a5"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.246405 19879 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:29.284379 19879 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:29.286283 19879 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:29.286437 19879 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:29.286636 19879 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:29.286974 19879 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:29.287012 19879 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.287051 19879 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:29.287076 19879 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.292742 19879 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:36775
I20260810 14:52:29.292858 20083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:36775 every 8 connection(s)
I20260810 14:52:29.293104 19879 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.194@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:29.301020 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.293760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:40891 (local address 127.19.29.254:45055)
0810 14:52:29.293838 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.293840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.294023 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:52:29.294558 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.294560 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.294570 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.294621 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.295507 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.296007 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.296905 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.297100 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.297147 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.298995 (+ 1848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.298996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.298997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:29.299004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.300043 (+ 1039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.300363 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.300364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.300364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.300407 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.300574 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.300575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.300575 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.300667 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.300713 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.300899 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.300958 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260810 14:52:29.301189 20091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.293746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45055 (local address 127.19.29.194:40891)
0810 14:52:29.293910 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.293946 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.294472 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.294677 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.294681 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.295222 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:29.295407 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.295412 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.296072 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.296072 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.296835 (+ 763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.296837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.297154 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.297155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.297245 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.297615 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:29.297623 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:29.298916 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:29.300105 (+ 1189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.300111 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.300113 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.300310 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.300449 (+ 139us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.300449 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.300450 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.300534 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.300708 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:29.300711 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:29.300811 (+ 100us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.300882 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.300987 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
I20260810 14:52:29.301631 20086 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45055
I20260810 14:52:29.301719 20086 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:29.301858 20086 heartbeater.cc:511] Master 127.19.29.254:45055 requested a full tablet report, sending...
I20260810 14:52:29.302193 19547 ts_manager.cc:194] Registered new tserver with Master: 9de95a44f8e84c45969b93a3ec5db83a (127.19.29.194:36775)
I20260810 14:52:29.302603 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 19879
I20260810 14:52:29.302650 19547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.194@KRBTEST.COM'} at 127.19.29.194:40891
I20260810 14:52:29.302700 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:29.302889 19575 external_mini_cluster.cc:1428] Setting key 878d22f7daf23350b14a079c008c4c2d
WARNING: no policy specified for kudu/127.19.29.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
Entry for principal kudu/127.19.29.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab.
I20260810 14:52:29.328356 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:29.409678 20097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.409878 20097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.409902 20097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.411051 20097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.411096 20097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.411123 20097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:29.412571 20097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.195.keytab
--principal=kudu/127.19.29.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:45055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.412799 20097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.413024 20097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.417832 20102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.417938 20106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.417924 20097 server_base.cc:1034] running on GCE node
W20260810 14:52:29.417815 20103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.418210 20097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.418448 20097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.419615 20097 hybrid_clock.cc:648] HybridClock initialized: now 1786373549419600 us; error 31 us; skew 500 ppm
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:29.422008 20097 init.cc:377] Logged in from keytab as kudu/127.19.29.195@KRBTEST.COM (short username kudu)
I20260810 14:52:29.422509 20097 webserver.cc:460] Webserver started at http://127.19.29.195:37119/ using document root <none> and password file <none>
I20260810 14:52:29.422709 20097 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.422757 20097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.422906 20097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.423902 20097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "9624356b27f34180944f1aad213093f3"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "27fcd3d89bfeea7115e8ea6ace98e65d"
server_key_iv: "c43400009799bb956f79cf020f03b9df"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.424252 20097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "9624356b27f34180944f1aad213093f3"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "27fcd3d89bfeea7115e8ea6ace98e65d"
server_key_iv: "c43400009799bb956f79cf020f03b9df"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.425472 20097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:29.426169 20121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.426337 20097 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:29.426427 20097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "9624356b27f34180944f1aad213093f3"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "27fcd3d89bfeea7115e8ea6ace98e65d"
server_key_iv: "c43400009799bb956f79cf020f03b9df"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.426492 20097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:29.441958 20097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:29.444121 20097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:29.444257 20097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:29.444454 20097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:29.444744 20097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:29.444785 20097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.444813 20097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:29.444835 20097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.450421 20097 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:35771
I20260810 14:52:29.450457 20301 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:35771 every 8 connection(s)
I20260810 14:52:29.450734 20097 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:29.452907 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20097
I20260810 14:52:29.453008 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:29.453171 19575 external_mini_cluster.cc:1428] Setting key 0dd6f9f2b1d4c05b3fc2c040e4b2cc77
Aug 10 14:52:29 dist-test-slave-4tdj krb5kdc[19470](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373549, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.195@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:29.458936 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.451340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:53859 (local address 127.19.29.254:45055)
0810 14:52:29.451393 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.451395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.451577 (+ 182us) server_negotiation.cc:407] Connection header received
0810 14:52:29.452010 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.452012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.452021 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.452079 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.452950 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.453587 (+ 637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.454691 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.454875 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.454926 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.456808 (+ 1882us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.456809 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.456809 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:29.456816 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.457849 (+ 1033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.458179 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.458180 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.458180 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.458229 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.458444 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.458444 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.458445 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.458562 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.458614 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.458817 (+ 203us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.458876 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:52:29.459051 20306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.451318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45055 (local address 127.19.29.195:53859)
0810 14:52:29.451466 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.451505 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.451937 (+ 432us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.452128 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.452131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.452639 (+ 508us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:29.452855 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.452862 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.453701 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.453702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.454621 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.454624 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.454935 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.454936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.455045 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.455459 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:29.455467 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:29.456722 (+ 1255us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:29.457912 (+ 1190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.457919 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.457921 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.458118 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.458274 (+ 156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:29.458274 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:29.458275 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:29.458397 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:29.458613 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:29.458616 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:29.458714 (+ 98us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.458785 (+ 71us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.458891 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":75,"threads_started":1}
I20260810 14:52:29.459450 20303 heartbeater.cc:347] Connected to a master server at 127.19.29.254:45055
I20260810 14:52:29.459529 20303 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:29.459679 20303 heartbeater.cc:511] Master 127.19.29.254:45055 requested a full tablet report, sending...
I20260810 14:52:29.460001 19547 ts_manager.cc:194] Registered new tserver with Master: 9624356b27f34180944f1aad213093f3 (127.19.29.195:35771)
I20260810 14:52:29.460322 19547 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.19.29.195@KRBTEST.COM'} at 127.19.29.195:53859
I20260810 14:52:29.464547 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:29.470737 19614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.465783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51276 (local address 127.19.29.254:45055)
0810 14:52:29.465822 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.465824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.465914 (+ 90us) server_negotiation.cc:407] Connection header received
0810 14:52:29.465969 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.465970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.465977 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.466011 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.466516 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.466969 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.467628 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.467790 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.467829 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.468719 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.468720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.468720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:29.468725 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.469883 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.470154 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.470155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.470155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.470196 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:29.470337 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:29.470337 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:29.470337 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:29.470460 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.470532 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.470614 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.470673 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:29.472123 19547 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:29.473693 19547 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:29.480147 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.475970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:36775 (local address 127.0.0.1:42418)
0810 14:52:29.476242 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.476253 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.476311 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.476992 (+ 681us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.476993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.476995 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:29.477051 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.477053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.477909 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.477910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.479189 (+ 1279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.479192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.479866 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.479944 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.479958 (+ 14us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.480024 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.480077 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":88,"threads_started":1}
I20260810 14:52:29.480237 20322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.475967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:35771 (local address 127.0.0.1:40386)
0810 14:52:29.476131 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.476171 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.476245 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.476700 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.476703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.476705 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:29.476769 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.476771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.478150 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.478151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.479094 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.479096 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.479999 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.480000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.480064 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.480067 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.480117 (+ 50us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.480150 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":54,"threads_started":1}
I20260810 14:52:29.480262 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.476083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40386 (local address 127.19.29.195:35771)
0810 14:52:29.476550 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.476554 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.476563 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:29.476595 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.476597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.476611 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.476692 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:29.476927 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.478024 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479173 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.479859 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479987 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.480049 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.480131 (+ 82us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.480173 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433,"thread_start_us":82,"threads_started":1}
I20260810 14:52:29.480331 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.476157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43739 (local address 127.0.0.1:45900)
0810 14:52:29.476397 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.476404 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.476444 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.476746 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.476747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.476749 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:29.476802 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.476804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.478107 (+ 1303us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.478108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.479196 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.479197 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.480104 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.480105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.480166 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.480171 (+ 5us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.480226 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.480267 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":64,"threads_started":1}
I20260810 14:52:29.480523 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.476377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45900 (local address 127.19.29.193:43739)
0810 14:52:29.476575 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.476580 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.476593 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:52:29.476638 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.476640 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.476657 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.476749 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:29.476862 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.477997 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479277 (+ 1280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.479954 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.480017 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.480066 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.480418 (+ 352us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.480453 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":93,"threads_started":1}
I20260810 14:52:29.480975 20195 tablet_service.cc:1467] Processing CreateTablet for tablet c222783518464943bb7f342d14c51e3b (DEFAULT_TABLE table=test-table [id=1297763ba3694a8abf783ee25b9064af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:29.481132 19762 tablet_service.cc:1467] Processing CreateTablet for tablet c222783518464943bb7f342d14c51e3b (DEFAULT_TABLE table=test-table [id=1297763ba3694a8abf783ee25b9064af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:29.481307 20195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c222783518464943bb7f342d14c51e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:29.481494 19762 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c222783518464943bb7f342d14c51e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:29.483978 20333 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Bootstrap starting.
I20260810 14:52:29.484154 20329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.476176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42418 (local address 127.19.29.194:36775)
0810 14:52:29.476834 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.476838 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.476847 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:29.476883 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.476885 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.476900 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.477125 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:29.477187 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.477818 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479305 (+ 1487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.479786 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.479849 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.479909 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.484023 (+ 4114us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.484077 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":615,"thread_start_us":86,"threads_started":1}
I20260810 14:52:29.484498 20335 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: Bootstrap starting.
I20260810 14:52:29.484851 20333 tablet_bootstrap.cc:654] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:29.484977 19983 tablet_service.cc:1467] Processing CreateTablet for tablet c222783518464943bb7f342d14c51e3b (DEFAULT_TABLE table=test-table [id=1297763ba3694a8abf783ee25b9064af]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:29.485139 20335 tablet_bootstrap.cc:654] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:29.485347 19983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c222783518464943bb7f342d14c51e3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:29.485419 20333 log.cc:824] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:29.485690 20335 log.cc:824] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:29.486227 20333 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: No bootstrap required, opened a new log
I20260810 14:52:29.486359 20333 ts_tablet_manager.cc:1397] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:29.486465 20335 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: No bootstrap required, opened a new log
I20260810 14:52:29.486541 20335 ts_tablet_manager.cc:1397] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:29.488171 20335 raft_consensus.cc:348] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.488315 20335 raft_consensus.cc:374] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:29.488350 20335 raft_consensus.cc:729] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a593133889d48b58cdb855bfb02d4e1, State: Initialized, Role: FOLLOWER
I20260810 14:52:29.488477 20335 consensus_queue.cc:260] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.488384 20333 raft_consensus.cc:348] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.488569 20333 raft_consensus.cc:374] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:29.488616 20333 raft_consensus.cc:729] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9624356b27f34180944f1aad213093f3, State: Initialized, Role: FOLLOWER
I20260810 14:52:29.488767 20335 ts_tablet_manager.cc:1428] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:29.488754 20333 consensus_queue.cc:260] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.488873 19871 heartbeater.cc:503] Master 127.19.29.254:45055 was elected leader, sending a full tablet report...
I20260810 14:52:29.489244 20333 ts_tablet_manager.cc:1428] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260810 14:52:29.489295 20303 heartbeater.cc:503] Master 127.19.29.254:45055 was elected leader, sending a full tablet report...
I20260810 14:52:29.489434 20338 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Bootstrap starting.
I20260810 14:52:29.490042 20338 tablet_bootstrap.cc:654] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:29.490535 20338 log.cc:824] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:29.491150 20338 tablet_bootstrap.cc:492] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: No bootstrap required, opened a new log
I20260810 14:52:29.491200 20338 ts_tablet_manager.cc:1397] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:29.491725 20339 raft_consensus.cc:482] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:29.491811 20339 raft_consensus.cc:504] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.492228 20339 leader_election.cc:288] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9624356b27f34180944f1aad213093f3 (127.19.29.195:35771), 9de95a44f8e84c45969b93a3ec5db83a (127.19.29.194:36775)
I20260810 14:52:29.493021 20338 raft_consensus.cc:348] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.493192 20338 raft_consensus.cc:374] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:29.493220 20338 raft_consensus.cc:729] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9de95a44f8e84c45969b93a3ec5db83a, State: Initialized, Role: FOLLOWER
I20260810 14:52:29.493315 20338 consensus_queue.cc:260] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.493569 20338 ts_tablet_manager.cc:1428] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260810 14:52:29.493687 20086 heartbeater.cc:503] Master 127.19.29.254:45055 was elected leader, sending a full tablet report...
I20260810 14:52:29.495879 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.492465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:59741 (local address 127.19.29.195:35771)
0810 14:52:29.492535 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.492537 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.492546 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:29.492567 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.492568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.492577 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.492628 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:29.492791 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.493440 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.494753 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.495106 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.495160 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.495167 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.495789 (+ 622us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.495819 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260810 14:52:29.495879 20329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.492526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:54325 (local address 127.19.29.194:36775)
0810 14:52:29.492560 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.492561 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.492569 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:29.492640 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.492640 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.492648 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.492699 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:29.492853 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.493394 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.495178 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.495549 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.495617 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.495625 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.495783 (+ 158us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.495824 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:29.495889 19876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.492358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:35771 (local address 127.19.29.193:59741)
0810 14:52:29.492400 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.492412 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.492457 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.492670 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.492671 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.492672 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:29.492728 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.492730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.493522 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.493523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.494660 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.494663 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.495658 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.495659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.495726 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.495728 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.495786 (+ 58us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.495815 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":85}
I20260810 14:52:29.495896 20343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.492359 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:36775 (local address 127.19.29.193:54325)
0810 14:52:29.492511 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.492522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.492576 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.492702 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.492703 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.492704 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:29.492757 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.492758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.493496 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.493498 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.495101 (+ 1603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.495104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.495625 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.495626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.495694 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.495698 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.495753 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.495790 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":648,"thread_start_us":83,"threads_started":1}
I20260810 14:52:29.496297 20227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c222783518464943bb7f342d14c51e3b" candidate_uuid: "9a593133889d48b58cdb855bfb02d4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9624356b27f34180944f1aad213093f3" is_pre_election: true
I20260810 14:52:29.496418 20227 raft_consensus.cc:2454] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a593133889d48b58cdb855bfb02d4e1 in term 0.
I20260810 14:52:29.496599 20012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c222783518464943bb7f342d14c51e3b" candidate_uuid: "9a593133889d48b58cdb855bfb02d4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de95a44f8e84c45969b93a3ec5db83a" is_pre_election: true
I20260810 14:52:29.496631 19685 leader_election.cc:302] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9624356b27f34180944f1aad213093f3, 9a593133889d48b58cdb855bfb02d4e1; no voters:
I20260810 14:52:29.496711 20012 raft_consensus.cc:2454] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a593133889d48b58cdb855bfb02d4e1 in term 0.
I20260810 14:52:29.496743 20339 raft_consensus.cc:2781] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:29.496797 20339 raft_consensus.cc:482] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:29.496817 20339 raft_consensus.cc:3037] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:29.497455 20339 raft_consensus.cc:504] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.497570 20339 leader_election.cc:288] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [CANDIDATE]: Term 1 election: Requested vote from peers 9624356b27f34180944f1aad213093f3 (127.19.29.195:35771), 9de95a44f8e84c45969b93a3ec5db83a (127.19.29.194:36775)
I20260810 14:52:29.497702 20227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c222783518464943bb7f342d14c51e3b" candidate_uuid: "9a593133889d48b58cdb855bfb02d4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9624356b27f34180944f1aad213093f3"
I20260810 14:52:29.497715 20012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c222783518464943bb7f342d14c51e3b" candidate_uuid: "9a593133889d48b58cdb855bfb02d4e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9de95a44f8e84c45969b93a3ec5db83a"
I20260810 14:52:29.497769 20227 raft_consensus.cc:3037] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:29.497782 20012 raft_consensus.cc:3037] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:29.498406 20227 raft_consensus.cc:2454] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a593133889d48b58cdb855bfb02d4e1 in term 1.
I20260810 14:52:29.498520 20012 raft_consensus.cc:2454] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a593133889d48b58cdb855bfb02d4e1 in term 1.
I20260810 14:52:29.498550 19685 leader_election.cc:302] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9624356b27f34180944f1aad213093f3, 9a593133889d48b58cdb855bfb02d4e1; no voters:
I20260810 14:52:29.498625 20339 raft_consensus.cc:2781] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:29.498752 20339 raft_consensus.cc:686] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [term 1 LEADER]: Becoming Leader. State: Replica: 9a593133889d48b58cdb855bfb02d4e1, State: Running, Role: LEADER
I20260810 14:52:29.498834 20339 consensus_queue.cc:237] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } }
I20260810 14:52:29.499528 19545 catalog_manager.cc:5495] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a593133889d48b58cdb855bfb02d4e1 (127.19.29.193). New cstate: current_term: 1 leader_uuid: "9a593133889d48b58cdb855bfb02d4e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a593133889d48b58cdb855bfb02d4e1" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 43739 } health_report { overall_health: HEALTHY } } }
I20260810 14:52:29.507481 20330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.505360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45916 (local address 127.19.29.193:43739)
0810 14:52:29.505413 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.505415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.505423 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:29.505495 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.505496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.505511 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.505566 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:29.505670 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.506100 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.506886 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.507076 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.507134 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.507240 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:29.507320 (+ 80us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:29.507378 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.507391 (+ 13us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.507409 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:52:29.509089 20012 raft_consensus.cc:1261] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 1 FOLLOWER]: Refusing update from remote peer 9a593133889d48b58cdb855bfb02d4e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:29.509089 20227 raft_consensus.cc:1261] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 1 FOLLOWER]: Refusing update from remote peer 9a593133889d48b58cdb855bfb02d4e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:29.509403 20339 consensus_queue.cc:1035] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9624356b27f34180944f1aad213093f3" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 35771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:29.509526 20347 consensus_queue.cc:1035] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9de95a44f8e84c45969b93a3ec5db83a" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 36775 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:29.512327 20353 mvcc.cc:205] Tried to move back new op lower bound from 7316986058786881536 to 7316986058747760640. Current Snapshot: MvccSnapshot[applied={T|T < 7316986058786881536}]
I20260810 14:52:29.513199 20354 mvcc.cc:205] Tried to move back new op lower bound from 7316986058786881536 to 7316986058747760640. Current Snapshot: MvccSnapshot[applied={T|T < 7316986058786881536}]
I20260810 14:52:29.514339 19545 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:29.514430 19545 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:29.515208 19545 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 68ab83b907a448979fb2ef0c919f5ab1: Sending DeleteTablet for 3 replicas of tablet c222783518464943bb7f342d14c51e3b
I20260810 14:52:29.515638 19762 tablet_service.cc:1514] Processing DeleteTablet for tablet c222783518464943bb7f342d14c51e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:29 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:45900
I20260810 14:52:29.515945 20361 tablet_replica.cc:330] T c222783518464943bb7f342d14c51e3b P 9a593133889d48b58cdb855bfb02d4e1: stopping tablet replica
I20260810 14:52:29.516062 20195 tablet_service.cc:1514] Processing DeleteTablet for tablet c222783518464943bb7f342d14c51e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:29 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:40386
I20260810 14:52:29.516109 19983 tablet_service.cc:1514] Processing DeleteTablet for tablet c222783518464943bb7f342d14c51e3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:29 UTC) from {username='kudu', principal='kudu/127.19.29.254@KRBTEST.COM'} at 127.0.0.1:42418
I20260810 14:52:29.516379 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19652
I20260810 14:52:29.519344 20363 tablet_replica.cc:330] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: stopping tablet replica
I20260810 14:52:29.519363 20362 tablet_replica.cc:330] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: stopping tablet replica
I20260810 14:52:29.519464 20363 raft_consensus.cc:2229] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:29.519578 20363 raft_consensus.cc:2258] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:29.519593 20362 raft_consensus.cc:2229] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:29.519767 20362 raft_consensus.cc:2258] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:29.521715 20362 ts_tablet_manager.cc:1905] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:29.523732 20362 ts_tablet_manager.cc:1918] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:29.523821 20362 log.cc:1196] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/c222783518464943bb7f342d14c51e3b
I20260810 14:52:29.524101 20362 ts_tablet_manager.cc:1939] T c222783518464943bb7f342d14c51e3b P 9624356b27f34180944f1aad213093f3: Deleting consensus metadata
I20260810 14:52:29.524535 19525 catalog_manager.cc:4841] TS 9624356b27f34180944f1aad213093f3 (127.19.29.195:35771): tablet c222783518464943bb7f342d14c51e3b (table test-table [id=1297763ba3694a8abf783ee25b9064af]) successfully deleted
I20260810 14:52:29.524678 20363 ts_tablet_manager.cc:1905] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:29.526013 20363 ts_tablet_manager.cc:1918] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:29.526079 20363 log.cc:1196] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/c222783518464943bb7f342d14c51e3b
I20260810 14:52:29.526311 20363 ts_tablet_manager.cc:1939] T c222783518464943bb7f342d14c51e3b P 9de95a44f8e84c45969b93a3ec5db83a: Deleting consensus metadata
I20260810 14:52:29.526724 19530 catalog_manager.cc:4841] TS 9de95a44f8e84c45969b93a3ec5db83a (127.19.29.194:36775): tablet c222783518464943bb7f342d14c51e3b (table test-table [id=1297763ba3694a8abf783ee25b9064af]) successfully deleted
W20260810 14:52:29.530037 19525 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:43739 (error 108)
I20260810 14:52:29.530573 20326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.530455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:43739 (local address 127.0.0.1:45920)
0810 14:52:29.530505 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.530544 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43739: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 14:52:29.530619 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19879
W20260810 14:52:29.530695 19525 catalog_manager.cc:4584] TS 9a593133889d48b58cdb855bfb02d4e1 (127.19.29.193:43739): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c222783518464943bb7f342d14c51e3b: Network error: Client connection negotiation failed: client connection to 127.19.29.193:43739: connect: Connection refused (error 111)
I20260810 14:52:29.539912 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20097
I20260810 14:52:29.546695 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 19498
2026-08-10T14:52:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2021 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-10T14:52:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:29Z Disabled control of system clock
I20260810 14:52:29.578778 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46041
--webserver_interface=127.19.29.254
--webserver_port=0
--builtin_ntp_servers=127.19.29.212:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:46041
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:29.658243 20371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.658543 20371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.658572 20371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.659739 20371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:29.659778 20371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.659789 20371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.659801 20371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:29.659811 20371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:29.661109 20371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:46041
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:46041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.661294 20371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.661525 20371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.666105 20385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.666090 20378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.666138 20371 server_base.cc:1034] running on GCE node
W20260810 14:52:29.666105 20380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.666565 20371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.666836 20371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.667982 20371 hybrid_clock.cc:648] HybridClock initialized: now 1786373549667972 us; error 28 us; skew 500 ppm
I20260810 14:52:29.669032 20371 webserver.cc:460] Webserver started at http://127.19.29.254:39769/ using document root <none> and password file <none>
I20260810 14:52:29.669229 20371 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.669267 20371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.669358 20371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.670339 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "27927071ae214af88c0c84f248279621"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "0b3ab91200a00aa5f773ce17884cbf9d"
server_key_iv: "72d3280ee0169cf8c0c3ab80d92c8d76"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.670744 20371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "27927071ae214af88c0c84f248279621"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "0b3ab91200a00aa5f773ce17884cbf9d"
server_key_iv: "72d3280ee0169cf8c0c3ab80d92c8d76"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.671953 20371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:29.672611 20392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.672763 20371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:29.672840 20371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "27927071ae214af88c0c84f248279621"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "0b3ab91200a00aa5f773ce17884cbf9d"
server_key_iv: "72d3280ee0169cf8c0c3ab80d92c8d76"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.672906 20371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:29.688606 20371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:29.688866 20371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:29.688982 20371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:29.692597 20371 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:46041
I20260810 14:52:29.692646 20480 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:46041 every 8 connection(s)
I20260810 14:52:29.692925 20371 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:29.693856 20481 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:29.696063 20481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: Bootstrap starting.
I20260810 14:52:29.696621 20481 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:29.696911 20481 log.cc:824] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:29.697670 20481 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: No bootstrap required, opened a new log
I20260810 14:52:29.699306 20481 raft_consensus.cc:348] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } }
I20260810 14:52:29.699440 20481 raft_consensus.cc:374] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:29.699473 20481 raft_consensus.cc:729] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 27927071ae214af88c0c84f248279621, State: Initialized, Role: FOLLOWER
I20260810 14:52:29.699600 20481 consensus_queue.cc:260] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } }
I20260810 14:52:29.699661 20481 raft_consensus.cc:388] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:29.699690 20481 raft_consensus.cc:482] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:29.699736 20481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:29.700234 20481 raft_consensus.cc:504] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } }
I20260810 14:52:29.700331 20481 leader_election.cc:302] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 27927071ae214af88c0c84f248279621; no voters:
I20260810 14:52:29.700497 20481 leader_election.cc:288] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:29.700541 20490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:29.700696 20490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [term 1 LEADER]: Becoming Leader. State: Replica: 27927071ae214af88c0c84f248279621, State: Running, Role: LEADER
I20260810 14:52:29.700735 20481 sys_catalog.cc:564] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:29.700798 20490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } }
I20260810 14:52:29.701181 20492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 27927071ae214af88c0c84f248279621. Latest consensus state: current_term: 1 leader_uuid: "27927071ae214af88c0c84f248279621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } } }
I20260810 14:52:29.701256 20491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "27927071ae214af88c0c84f248279621" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "27927071ae214af88c0c84f248279621" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 46041 } } }
I20260810 14:52:29.701383 20491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:29.701268 20492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:29.701658 20505 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:29.702168 20505 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:29.702991 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20371
I20260810 14:52:29.703110 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:29.703300 19575 external_mini_cluster.cc:1428] Setting key 211093382a8a208fdd59e43da26695b7
I20260810 14:52:29.703713 20505 catalog_manager.cc:1347] Generated new cluster ID: ec59b6580e154637941675a9c59c86b5
I20260810 14:52:29.703764 20505 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:29.709185 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.703929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57602 (local address 127.19.29.254:46041)
0810 14:52:29.704118 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.704126 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.704155 (+ 29us) server_negotiation.cc:407] Connection header received
0810 14:52:29.704266 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.704273 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.704334 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.704453 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.704682 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.706011 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.707121 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.707724 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.707826 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.708521 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.708524 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.708525 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:29.708719 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.708757 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:29.708771 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.708826 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.708913 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.708982 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
I20260810 14:52:29.716867 20505 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:29.717330 20505 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:29.723232 20505 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: Generated new TSK 0
I20260810 14:52:29.723372 20505 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:29.728624 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.193:0
--local_ip_for_outbound_sockets=127.19.29.193
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--builtin_ntp_servers=127.19.29.212:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:29.812093 20522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.812286 20522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.812315 20522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.813422 20522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.813462 20522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.813493 20522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.193
I20260810 14:52:29.814837 20522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.19.29.193
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.193
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.815059 20522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.815331 20522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.820084 20527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.820128 20532 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.820361 20522 server_base.cc:1034] running on GCE node
W20260810 14:52:29.820403 20529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.820608 20522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.820855 20522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.822013 20522 hybrid_clock.cc:648] HybridClock initialized: now 1786373549821999 us; error 31 us; skew 500 ppm
I20260810 14:52:29.823423 20522 webserver.cc:460] Webserver started at http://127.19.29.193:39967/ using document root <none> and password file <none>
I20260810 14:52:29.823668 20522 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.823724 20522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.823844 20522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.825073 20522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data/instance:
uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "577edaaa40df80e47f022581f26b1e9a"
server_key_iv: "b8d2c2b65417af5a9fae57abae7d3e0f"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.825456 20522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance:
uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "577edaaa40df80e47f022581f26b1e9a"
server_key_iv: "b8d2c2b65417af5a9fae57abae7d3e0f"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.827075 20522 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:29.827705 20539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.827857 20522 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:29.827940 20522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal
uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "577edaaa40df80e47f022581f26b1e9a"
server_key_iv: "b8d2c2b65417af5a9fae57abae7d3e0f"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.828004 20522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:29.852953 20522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:29.853215 20522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:29.853338 20522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:29.853534 20522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:29.853829 20522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:29.853863 20522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.853891 20522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:29.853907 20522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.859306 20522 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.193:42287
I20260810 14:52:29.859377 20718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.193:42287 every 8 connection(s)
I20260810 14:52:29.859650 20522 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/data/info.pb
I20260810 14:52:29.864315 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.860267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.193:58939 (local address 127.19.29.254:46041)
0810 14:52:29.860320 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:29.860322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:29.860535 (+ 213us) server_negotiation.cc:407] Connection header received
0810 14:52:29.860974 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:29.860975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:29.860984 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:29.861038 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:29.861649 (+ 611us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.862123 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.863169 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.863355 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.863404 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.864107 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:29.864109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:29.864109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:29.864114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:29.864127 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:29.864131 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:29.864171 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:29.864233 (+ 62us) server_negotiation.cc:299] Negotiation successful
0810 14:52:29.864258 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:52:29.864492 20721 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:29.860242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46041 (local address 127.19.29.193:58939)
0810 14:52:29.860424 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:29.860461 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:29.860900 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:29.861105 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:29.861109 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:29.861117 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:29.861586 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.861590 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.862182 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.862182 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.863102 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:29.863105 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:29.863412 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:29.863413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:29.863509 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:29.863968 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:29.863969 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:29.863995 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:29.864017 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:29.864178 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:29.864181 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:29.864183 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:29.864226 (+ 43us) client_negotiation.cc:240] Negotiation successful
0810 14:52:29.864300 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260810 14:52:29.864915 20719 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46041
I20260810 14:52:29.864993 20719 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:29.865140 20719 heartbeater.cc:511] Master 127.19.29.254:46041 requested a full tablet report, sending...
I20260810 14:52:29.865573 20423 ts_manager.cc:194] Registered new tserver with Master: 224d7a3ef05b4d20a17a59c3f6db1f1e (127.19.29.193:42287)
I20260810 14:52:29.866132 20423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.193:58939
I20260810 14:52:29.867338 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20522
I20260810 14:52:29.867426 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-0/wal/instance
I20260810 14:52:29.867595 19575 external_mini_cluster.cc:1428] Setting key 7d54f0806af5aace55280fabd84134b0
I20260810 14:52:29.868350 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.194:0
--local_ip_for_outbound_sockets=127.19.29.194
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--builtin_ntp_servers=127.19.29.212:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260810 14:52:29.949251 20722 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:29.949451 20722 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:29.949502 20722 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:29.950625 20722 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:29.950662 20722 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:29.950687 20722 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.194
I20260810 14:52:29.951974 20722 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.19.29.194
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20722
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.194
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:29.952160 20722 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:29.952400 20722 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:29.957284 20742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.957343 20736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:29.957362 20735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:29.957418 20722 server_base.cc:1034] running on GCE node
I20260810 14:52:29.957701 20722 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:29.957898 20722 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:29.959036 20722 hybrid_clock.cc:648] HybridClock initialized: now 1786373549959021 us; error 32 us; skew 500 ppm
I20260810 14:52:29.960219 20722 webserver.cc:460] Webserver started at http://127.19.29.194:41657/ using document root <none> and password file <none>
I20260810 14:52:29.960421 20722 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:29.960465 20722 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:29.960604 20722 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:29.961591 20722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data/instance:
uuid: "b938328ff59b4b22bcb9a6f467cd74c6"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "803e7ef557c5f45641e2f0c88e87bafd"
server_key_iv: "6c036f1541cac6c36172f434c6511113"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.961901 20722 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance:
uuid: "b938328ff59b4b22bcb9a6f467cd74c6"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "803e7ef557c5f45641e2f0c88e87bafd"
server_key_iv: "6c036f1541cac6c36172f434c6511113"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.963236 20722 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:29.963913 20754 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:29.964083 20722 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:29.964166 20722 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal
uuid: "b938328ff59b4b22bcb9a6f467cd74c6"
format_stamp: "Formatted at 2026-08-10 14:52:29 on dist-test-slave-4tdj"
server_key: "803e7ef557c5f45641e2f0c88e87bafd"
server_key_iv: "6c036f1541cac6c36172f434c6511113"
server_key_version: "encryptionkey@0"
I20260810 14:52:29.964231 20722 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:30.003140 20722 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:30.003499 20722 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:30.003675 20722 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:30.003913 20722 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:30.004215 20722 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:30.004248 20722 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.004269 20722 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:30.004284 20722 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.009692 20722 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.194:46201
I20260810 14:52:30.009745 20935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.194:46201 every 8 connection(s)
I20260810 14:52:30.010068 20722 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/data/info.pb
I20260810 14:52:30.013887 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20722
I20260810 14:52:30.013981 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal/instance
I20260810 14:52:30.014166 19575 external_mini_cluster.cc:1428] Setting key aa1454df7defde7c6bc8dae2a4ad90d7
I20260810 14:52:30.015187 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.010794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.194:52621 (local address 127.19.29.254:46041)
0810 14:52:30.010844 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.010846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.011083 (+ 237us) server_negotiation.cc:407] Connection header received
0810 14:52:30.011600 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.011601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.011614 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.011667 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:30.012339 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.012847 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.013828 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.014066 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.014144 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.014964 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:30.014965 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:30.014965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:30.014969 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:30.014983 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:30.014986 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:30.015026 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.015101 (+ 75us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.015128 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260810 14:52:30.015211 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.19.29.195:0
--local_ip_for_outbound_sockets=127.19.29.195
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--builtin_ntp_servers=127.19.29.212:41225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260810 14:52:30.015424 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.010781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46041 (local address 127.19.29.194:52621)
0810 14:52:30.010964 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.010999 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.011495 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.011737 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.011741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.011749 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:30.012250 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.012255 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.012935 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.012936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.013730 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.013734 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.014168 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.014170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.014351 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.014821 (+ 470us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:30.014821 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:30.014856 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:30.014879 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:30.015030 (+ 151us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:30.015034 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:30.015038 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.015100 (+ 62us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.015212 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260810 14:52:30.015822 20936 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46041
I20260810 14:52:30.015913 20936 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:30.016094 20936 heartbeater.cc:511] Master 127.19.29.254:46041 requested a full tablet report, sending...
I20260810 14:52:30.016438 20423 ts_manager.cc:194] Registered new tserver with Master: b938328ff59b4b22bcb9a6f467cd74c6 (127.19.29.194:46201)
I20260810 14:52:30.016881 20423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.194:52621
W20260810 14:52:30.095616 20940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:30.095816 20940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:30.095837 20940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:30.096962 20940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:30.097002 20940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:30.097028 20940 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.19.29.195
I20260810 14:52:30.098443 20940 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:41225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.19.29.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.19.29.195
--webserver_port=0
--tserver_master_addrs=127.19.29.254:46041
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.19.29.195
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:30.098672 20940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:30.098950 20940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:30.103935 20946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:30.103960 20951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:30.104156 20940 server_base.cc:1034] running on GCE node
W20260810 14:52:30.104164 20945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:30.104395 20940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:30.104635 20940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:30.105783 20940 hybrid_clock.cc:648] HybridClock initialized: now 1786373550105767 us; error 27 us; skew 500 ppm
I20260810 14:52:30.107086 20940 webserver.cc:460] Webserver started at http://127.19.29.195:34897/ using document root <none> and password file <none>
I20260810 14:52:30.107319 20940 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:30.107369 20940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:30.107492 20940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:30.108538 20940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data/instance:
uuid: "0e7ba3de6f8b4446ada6bc0791cc5714"
format_stamp: "Formatted at 2026-08-10 14:52:30 on dist-test-slave-4tdj"
server_key: "79d5814a1838dc0c15331692050c49ba"
server_key_iv: "9ecfb41e31eea1e1ca3f6eae5b95b0c6"
server_key_version: "encryptionkey@0"
I20260810 14:52:30.108865 20940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance:
uuid: "0e7ba3de6f8b4446ada6bc0791cc5714"
format_stamp: "Formatted at 2026-08-10 14:52:30 on dist-test-slave-4tdj"
server_key: "79d5814a1838dc0c15331692050c49ba"
server_key_iv: "9ecfb41e31eea1e1ca3f6eae5b95b0c6"
server_key_version: "encryptionkey@0"
I20260810 14:52:30.110117 20940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:30.110949 20961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.111110 20940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.111197 20940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal
uuid: "0e7ba3de6f8b4446ada6bc0791cc5714"
format_stamp: "Formatted at 2026-08-10 14:52:30 on dist-test-slave-4tdj"
server_key: "79d5814a1838dc0c15331692050c49ba"
server_key_iv: "9ecfb41e31eea1e1ca3f6eae5b95b0c6"
server_key_version: "encryptionkey@0"
I20260810 14:52:30.111265 20940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:30.133416 20940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:30.133718 20940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:30.133847 20940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:30.134063 20940 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260810 14:52:30.134413 20940 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260810 14:52:30.134461 20940 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.134491 20940 ts_tablet_manager.cc:610] Registered 0 tablets
I20260810 14:52:30.134511 20940 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:30.139909 20940 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.195:41449
I20260810 14:52:30.139951 21140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.195:41449 every 8 connection(s)
I20260810 14:52:30.140264 20940 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/data/info.pb
I20260810 14:52:30.140763 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 20940
I20260810 14:52:30.140849 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal/instance
I20260810 14:52:30.141036 19575 external_mini_cluster.cc:1428] Setting key 53ffab603212f6263f193cb82f266390
I20260810 14:52:30.145148 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.140966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:37805 (local address 127.19.29.254:46041)
0810 14:52:30.141026 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.141029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.141321 (+ 292us) server_negotiation.cc:407] Connection header received
0810 14:52:30.141937 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.141937 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.141947 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.141988 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:30.142684 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.143167 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.144074 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.144251 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.144296 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.144955 (+ 659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:30.144956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:30.144956 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:30.144960 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:30.144973 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:30.144977 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:30.145014 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.145065 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.145089 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260810 14:52:30.145327 21145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.140967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:46041 (local address 127.19.29.195:37805)
0810 14:52:30.141187 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.141227 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.141840 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.142044 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.142047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.142055 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:30.142610 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.142615 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.143227 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.143227 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.144015 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.144017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.144306 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.144307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.144410 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.144841 (+ 431us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0810 14:52:30.144841 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:30.144868 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0810 14:52:30.144889 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:30.145015 (+ 126us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:30.145017 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:30.145019 (+ 2us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.145061 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.145135 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
I20260810 14:52:30.145727 21142 heartbeater.cc:347] Connected to a master server at 127.19.29.254:46041
I20260810 14:52:30.145812 21142 heartbeater.cc:464] Registering TS with master...
I20260810 14:52:30.145951 21142 heartbeater.cc:511] Master 127.19.29.254:46041 requested a full tablet report, sending...
I20260810 14:52:30.146270 20423 ts_manager.cc:194] Registered new tserver with Master: 0e7ba3de6f8b4446ada6bc0791cc5714 (127.19.29.195:41449)
I20260810 14:52:30.146622 20423 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.19.29.195:37805
I20260810 14:52:30.152552 19575 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260810 14:52:30.156586 20521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.153967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57604 (local address 127.19.29.254:46041)
0810 14:52:30.154006 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.154007 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.154098 (+ 91us) server_negotiation.cc:407] Connection header received
0810 14:52:30.154167 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.154168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.154178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.154222 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:30.154397 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.154846 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.155530 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.155723 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.155774 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.156374 (+ 600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:30.156375 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:30.156376 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:30.156380 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:30.156393 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:30.156397 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:30.156440 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.156492 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.156516 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:52:30.157826 20423 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57604:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260810 14:52:30.159384 20423 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260810 14:52:30.165263 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39630 (local address 127.19.29.194:46201)
0810 14:52:30.161627 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.161633 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.161669 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:52:30.161769 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.161772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.161788 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.161865 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:30.162037 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.162871 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.163906 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.164867 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.164938 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165028 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.165126 (+ 98us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.165165 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":83,"threads_started":1}
I20260810 14:52:30.165256 21155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:46201 (local address 127.0.0.1:39630)
0810 14:52:30.161576 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.161617 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.161690 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.161877 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.161880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.161883 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:30.161943 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.161944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.162941 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.162942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.163823 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.163826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.164950 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.164951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.165028 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165040 (+ 12us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.165114 (+ 74us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.165170 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":235,"thread_start_us":63,"threads_started":1}
I20260810 14:52:30.165541 21154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.195:41449 (local address 127.0.0.1:47174)
0810 14:52:30.161791 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.161800 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.161880 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.162114 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.162115 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.162117 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:30.162154 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.162156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.163408 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.163408 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.164373 (+ 965us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.164376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.165325 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.165326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.165389 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165393 (+ 4us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.165439 (+ 46us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.165476 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":469,"mutex_wait_us":35,"thread_start_us":76,"threads_started":1}
I20260810 14:52:30.165572 21158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47174 (local address 127.19.29.195:41449)
0810 14:52:30.161690 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.161694 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.161854 (+ 160us) server_negotiation.cc:407] Connection header received
0810 14:52:30.161951 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.161954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.161968 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.162046 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:30.162231 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.163314 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.164460 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.165137 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.165176 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165261 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.165466 (+ 205us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.165503 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":73,"threads_started":1}
I20260810 14:52:30.166163 21036 tablet_service.cc:1467] Processing CreateTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 (DEFAULT_TABLE table=test-table [id=7f0b06e3caec45a78efbe0ffaf29901d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:30.166163 20838 tablet_service.cc:1467] Processing CreateTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 (DEFAULT_TABLE table=test-table [id=7f0b06e3caec45a78efbe0ffaf29901d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:30.166550 21036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51c7bdf04dd4ad99a48a736638d1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:30.166571 20838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51c7bdf04dd4ad99a48a736638d1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:30.166577 21159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161696 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52244 (local address 127.19.29.193:42287)
0810 14:52:30.161844 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.161848 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.162063 (+ 215us) server_negotiation.cc:407] Connection header received
0810 14:52:30.162123 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.162135 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.162150 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.162220 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:30.162436 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.163510 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.164428 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.164911 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.164976 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165064 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.165302 (+ 238us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.166491 (+ 1189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
I20260810 14:52:30.166759 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.161329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:42287 (local address 127.0.0.1:52244)
0810 14:52:30.161959 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.161966 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.162003 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.162314 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.162316 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.162318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:30.162356 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.162358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.163589 (+ 1231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.163590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.164352 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.164355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.165109 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.165110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.165163 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.165166 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.165225 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.165258 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"thread_start_us":86,"threads_started":1}
I20260810 14:52:30.169818 21161 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Bootstrap starting.
I20260810 14:52:30.169818 21163 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Bootstrap starting.
I20260810 14:52:30.170511 21163 tablet_bootstrap.cc:654] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:30.170511 21161 tablet_bootstrap.cc:654] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:30.170542 20616 tablet_service.cc:1467] Processing CreateTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 (DEFAULT_TABLE table=test-table [id=7f0b06e3caec45a78efbe0ffaf29901d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260810 14:52:30.170848 21161 log.cc:824] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:30.170848 21163 log.cc:824] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:30.170898 20616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b51c7bdf04dd4ad99a48a736638d1816. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:30.171686 21161 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: No bootstrap required, opened a new log
I20260810 14:52:30.171764 21161 ts_tablet_manager.cc:1397] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:30.171855 21163 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: No bootstrap required, opened a new log
I20260810 14:52:30.171921 21163 ts_tablet_manager.cc:1397] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:30.173611 21171 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: Bootstrap starting.
I20260810 14:52:30.174192 21171 tablet_bootstrap.cc:654] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:30.174275 21161 raft_consensus.cc:348] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.174484 21161 raft_consensus.cc:374] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:30.174428 21163 raft_consensus.cc:348] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.174501 21171 log.cc:824] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:30.174526 21161 raft_consensus.cc:729] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b938328ff59b4b22bcb9a6f467cd74c6, State: Initialized, Role: FOLLOWER
I20260810 14:52:30.174553 21163 raft_consensus.cc:374] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:30.174583 21163 raft_consensus.cc:729] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7ba3de6f8b4446ada6bc0791cc5714, State: Initialized, Role: FOLLOWER
I20260810 14:52:30.174679 21163 consensus_queue.cc:260] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.174677 21161 consensus_queue.cc:260] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.174933 21163 ts_tablet_manager.cc:1428] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260810 14:52:30.174933 21161 ts_tablet_manager.cc:1428] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s
I20260810 14:52:30.175053 21142 heartbeater.cc:503] Master 127.19.29.254:46041 was elected leader, sending a full tablet report...
I20260810 14:52:30.175141 20936 heartbeater.cc:503] Master 127.19.29.254:46041 was elected leader, sending a full tablet report...
I20260810 14:52:30.175495 21171 tablet_bootstrap.cc:492] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: No bootstrap required, opened a new log
I20260810 14:52:30.175567 21171 ts_tablet_manager.cc:1397] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260810 14:52:30.177552 21171 raft_consensus.cc:348] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.177677 21171 raft_consensus.cc:374] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:30.177697 21171 raft_consensus.cc:729] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 224d7a3ef05b4d20a17a59c3f6db1f1e, State: Initialized, Role: FOLLOWER
I20260810 14:52:30.177807 21171 consensus_queue.cc:260] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.178028 21171 ts_tablet_manager.cc:1428] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260810 14:52:30.178087 20719 heartbeater.cc:503] Master 127.19.29.254:46041 was elected leader, sending a full tablet report...
W20260810 14:52:30.260671 20937 tablet.cc:2369] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260810 14:52:30.299250 21174 raft_consensus.cc:482] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260810 14:52:30.299386 21174 raft_consensus.cc:504] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.299719 21174 leader_election.cc:288] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b938328ff59b4b22bcb9a6f467cd74c6 (127.19.29.194:46201), 224d7a3ef05b4d20a17a59c3f6db1f1e (127.19.29.193:42287)
I20260810 14:52:30.302850 21145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.299915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:42287 (local address 127.19.29.195:36265)
0810 14:52:30.299991 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.300002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.300047 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.300200 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.300200 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.300202 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:30.300270 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.300271 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.301201 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.301202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.301984 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.301986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.302621 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.302690 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.302693 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.302735 (+ 42us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.302778 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 14:52:30.302850 21159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.300027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:36265 (local address 127.19.29.193:42287)
0810 14:52:30.300092 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.300094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.300103 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:30.300131 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.300132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.300144 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.300187 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:30.300503 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.301121 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302112 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.302545 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302614 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.302624 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.302747 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.302781 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260810 14:52:30.303102 21156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.299997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.19.29.195:37767 (local address 127.19.29.194:46201)
0810 14:52:30.300056 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.300058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.300337 (+ 279us) server_negotiation.cc:407] Connection header received
0810 14:52:30.300409 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.300410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.300425 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.300487 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0810 14:52:30.300649 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.301262 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302343 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.302716 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302786 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.302794 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.302982 (+ 188us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.303029 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260810 14:52:30.303170 20649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51c7bdf04dd4ad99a48a736638d1816" candidate_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" is_pre_election: true
I20260810 14:52:30.303325 21179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.299919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.194:46201 (local address 127.19.29.195:37767)
0810 14:52:30.300260 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.300270 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:30.300334 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:30.300491 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:30.300492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:30.300494 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0810 14:52:30.300574 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.300576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.301352 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.301353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.302226 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:30.302229 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.302808 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.302809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:30.302873 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.302876 (+ 3us) client_negotiation.cc:769] Sending connection context
0810 14:52:30.303197 (+ 321us) client_negotiation.cc:240] Negotiation successful
0810 14:52:30.303240 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":151,"thread_start_us":120,"threads_started":1}
I20260810 14:52:30.303340 20649 raft_consensus.cc:2454] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7ba3de6f8b4446ada6bc0791cc5714 in term 0.
I20260810 14:52:30.303563 20966 leader_election.cc:302] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7ba3de6f8b4446ada6bc0791cc5714, 224d7a3ef05b4d20a17a59c3f6db1f1e; no voters:
I20260810 14:52:30.303691 21174 raft_consensus.cc:2781] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260810 14:52:30.303735 21174 raft_consensus.cc:482] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260810 14:52:30.303758 21174 raft_consensus.cc:3037] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:30.303705 20863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51c7bdf04dd4ad99a48a736638d1816" candidate_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" is_pre_election: true
I20260810 14:52:30.303870 20863 raft_consensus.cc:2454] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7ba3de6f8b4446ada6bc0791cc5714 in term 0.
I20260810 14:52:30.304611 21174 raft_consensus.cc:504] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.304736 21174 leader_election.cc:288] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [CANDIDATE]: Term 1 election: Requested vote from peers b938328ff59b4b22bcb9a6f467cd74c6 (127.19.29.194:46201), 224d7a3ef05b4d20a17a59c3f6db1f1e (127.19.29.193:42287)
I20260810 14:52:30.304870 20649 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51c7bdf04dd4ad99a48a736638d1816" candidate_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e"
I20260810 14:52:30.304900 20863 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b51c7bdf04dd4ad99a48a736638d1816" candidate_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b938328ff59b4b22bcb9a6f467cd74c6"
I20260810 14:52:30.304942 20649 raft_consensus.cc:3037] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:30.304978 20863 raft_consensus.cc:3037] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:30.305670 20649 raft_consensus.cc:2454] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7ba3de6f8b4446ada6bc0791cc5714 in term 1.
I20260810 14:52:30.305760 20863 raft_consensus.cc:2454] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7ba3de6f8b4446ada6bc0791cc5714 in term 1.
I20260810 14:52:30.305805 20966 leader_election.cc:302] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7ba3de6f8b4446ada6bc0791cc5714, 224d7a3ef05b4d20a17a59c3f6db1f1e; no voters:
I20260810 14:52:30.305894 21174 raft_consensus.cc:2781] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:30.306037 21174 raft_consensus.cc:686] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 1 LEADER]: Becoming Leader. State: Replica: 0e7ba3de6f8b4446ada6bc0791cc5714, State: Running, Role: LEADER
I20260810 14:52:30.306131 21174 consensus_queue.cc:237] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } }
I20260810 14:52:30.306916 20422 catalog_manager.cc:5495] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7ba3de6f8b4446ada6bc0791cc5714 (127.19.29.195). New cstate: current_term: 1 leader_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0e7ba3de6f8b4446ada6bc0791cc5714" member_type: VOTER last_known_addr { host: "127.19.29.195" port: 41449 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 } health_report { overall_health: UNKNOWN } } }
I20260810 14:52:30.344801 21158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.342524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47186 (local address 127.19.29.195:41449)
0810 14:52:30.342580 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:30.342582 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:30.342593 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:52:30.342684 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:30.342685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:30.342704 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:30.342763 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:30.342882 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.343362 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.344092 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:30.344278 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:30.344332 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:30.344474 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:30.344578 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:30.344648 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:30.344686 (+ 38us) server_negotiation.cc:299] Negotiation successful
0810 14:52:30.344705 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:52:30.346582 20649 raft_consensus.cc:1261] T b51c7bdf04dd4ad99a48a736638d1816 P 224d7a3ef05b4d20a17a59c3f6db1f1e [term 1 FOLLOWER]: Refusing update from remote peer 0e7ba3de6f8b4446ada6bc0791cc5714: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:30.346591 20863 raft_consensus.cc:1261] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 1 FOLLOWER]: Refusing update from remote peer 0e7ba3de6f8b4446ada6bc0791cc5714: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:30.346905 21174 consensus_queue.cc:1035] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b938328ff59b4b22bcb9a6f467cd74c6" member_type: VOTER last_known_addr { host: "127.19.29.194" port: 46201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:30.347043 21181 consensus_queue.cc:1035] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [LEADER]: Connected to new peer: Peer: permanent_uuid: "224d7a3ef05b4d20a17a59c3f6db1f1e" member_type: VOTER last_known_addr { host: "127.19.29.193" port: 42287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:30.349294 21188 mvcc.cc:205] Tried to move back new op lower bound from 7316986062216970240 to 7316986062054649856. Current Snapshot: MvccSnapshot[applied={T|T < 7316986062216970240}]
I20260810 14:52:30.351660 20423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:57604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:30.351742 20423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:57604:
table { table_name: "test-table" } modify_external_catalogs: true
I20260810 14:52:30.352459 20423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 27927071ae214af88c0c84f248279621: Sending DeleteTablet for 3 replicas of tablet b51c7bdf04dd4ad99a48a736638d1816
I20260810 14:52:30.352761 21036 tablet_service.cc:1514] Processing DeleteTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:30 UTC) from {username='slave'} at 127.0.0.1:47174
I20260810 14:52:30.352777 20838 tablet_service.cc:1514] Processing DeleteTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:30 UTC) from {username='slave'} at 127.0.0.1:39630
I20260810 14:52:30.352813 20616 tablet_service.cc:1514] Processing DeleteTablet for tablet b51c7bdf04dd4ad99a48a736638d1816 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-10 14:52:30 UTC) from {username='slave'} at 127.0.0.1:52244
I20260810 14:52:30.353044 21200 tablet_replica.cc:330] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: stopping tablet replica
I20260810 14:52:30.353202 21200 raft_consensus.cc:2229] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260810 14:52:30.353313 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20522
I20260810 14:52:30.353367 21200 raft_consensus.cc:2258] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:30.356526 21200 ts_tablet_manager.cc:1905] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:30.358213 21200 ts_tablet_manager.cc:1918] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:30.358280 21200 log.cc:1196] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-1/wal/wals/b51c7bdf04dd4ad99a48a736638d1816
I20260810 14:52:30.358582 21200 ts_tablet_manager.cc:1939] T b51c7bdf04dd4ad99a48a736638d1816 P b938328ff59b4b22bcb9a6f467cd74c6: Deleting consensus metadata
I20260810 14:52:30.358989 20395 catalog_manager.cc:4841] TS b938328ff59b4b22bcb9a6f467cd74c6 (127.19.29.194:46201): tablet b51c7bdf04dd4ad99a48a736638d1816 (table test-table [id=7f0b06e3caec45a78efbe0ffaf29901d]) successfully deleted
I20260810 14:52:30.361857 21199 tablet_replica.cc:330] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: stopping tablet replica
I20260810 14:52:30.361972 21199 raft_consensus.cc:2229] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 1 LEADER]: Raft consensus shutting down.
I20260810 14:52:30.362113 21199 raft_consensus.cc:2258] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260810 14:52:30.362509 21199 ts_tablet_manager.cc:1905] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260810 14:52:30.364203 21199 ts_tablet_manager.cc:1918] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260810 14:52:30.364300 21199 log.cc:1196] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Deleting WAL directory at /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786373310130398-19575-0/minicluster-data/ts-2/wal/wals/b51c7bdf04dd4ad99a48a736638d1816
I20260810 14:52:30.364589 21199 ts_tablet_manager.cc:1939] T b51c7bdf04dd4ad99a48a736638d1816 P 0e7ba3de6f8b4446ada6bc0791cc5714: Deleting consensus metadata
I20260810 14:52:30.364979 20397 catalog_manager.cc:4841] TS 0e7ba3de6f8b4446ada6bc0791cc5714 (127.19.29.195:41449): tablet b51c7bdf04dd4ad99a48a736638d1816 (table test-table [id=7f0b06e3caec45a78efbe0ffaf29901d]) successfully deleted
W20260810 14:52:30.368736 20396 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.19.29.193:42287 (error 108)
I20260810 14:52:30.369223 21153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:30.369081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.193:42287 (local address 127.0.0.1:52252)
0810 14:52:30.369140 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:30.369186 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.193:42287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 14:52:30.369253 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20722
W20260810 14:52:30.374914 20396 catalog_manager.cc:4584] TS 224d7a3ef05b4d20a17a59c3f6db1f1e (127.19.29.193:42287): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b51c7bdf04dd4ad99a48a736638d1816: Network error: Client connection negotiation failed: client connection to 127.19.29.193:42287: connect: Connection refused (error 111)
I20260810 14:52:30.386265 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20940
I20260810 14:52:30.397796 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 20371
2026-08-10T14:52:30Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (854 ms)
[----------] 6 tests from EncryptionPolicyTest (9167 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:30 dist-test-slave-4tdj krb5kdc[21209](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:30 dist-test-slave-4tdj krb5kdc[21209](info): set up 2 sockets
Aug 10 14:52:30 dist-test-slave-4tdj krb5kdc[21209](info): commencing operation
krb5kdc: starting...
W20260810 14:52:31.572082 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.146s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:31.684725 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32875
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32875
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:31.763367 21230 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:31.763556 21230 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:31.763577 21230 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:31.764684 21230 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:31.764724 21230 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:31.764737 21230 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:31.764748 21230 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:31.764760 21230 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:31.766234 21230 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32875
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32875
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21230
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:31.766474 21230 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:31.766690 21230 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:31.771224 21236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:31.771347 21230 server_base.cc:1034] running on GCE node
W20260810 14:52:31.771327 21242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:31.771220 21238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:31.771663 21230 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:31.771941 21230 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:31.773084 21230 hybrid_clock.cc:648] HybridClock initialized: now 1786373551773077 us; error 37 us; skew 500 ppm
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21209](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373551, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:31.775427 21230 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:31.775810 21230 webserver.cc:460] Webserver started at http://127.0.0.1:43333/ using document root <none> and password file <none>
I20260810 14:52:31.776010 21230 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:31.776054 21230 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:31.776185 21230 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:31.777174 21230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "5e46769d1cfd4e7fa58948189a85bbdc"
format_stamp: "Formatted at 2026-08-10 14:52:31 on dist-test-slave-4tdj"
server_key: "9c2931f7d5303077fc6f958a711d0814"
server_key_iv: "a582a561ea83c09d23a253fc3ba062ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:31.777486 21230 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "5e46769d1cfd4e7fa58948189a85bbdc"
format_stamp: "Formatted at 2026-08-10 14:52:31 on dist-test-slave-4tdj"
server_key: "9c2931f7d5303077fc6f958a711d0814"
server_key_iv: "a582a561ea83c09d23a253fc3ba062ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:31.778761 21230 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:31.779409 21254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:31.779551 21230 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:31.779636 21230 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "5e46769d1cfd4e7fa58948189a85bbdc"
format_stamp: "Formatted at 2026-08-10 14:52:31 on dist-test-slave-4tdj"
server_key: "9c2931f7d5303077fc6f958a711d0814"
server_key_iv: "a582a561ea83c09d23a253fc3ba062ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:31.779692 21230 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:31.794474 21230 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:31.796286 21230 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:31.796415 21230 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:31.800248 21230 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32875
I20260810 14:52:31.800282 21335 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32875 every 8 connection(s)
I20260810 14:52:31.800587 21230 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:31.801396 21340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:31.803661 21340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc: Bootstrap starting.
I20260810 14:52:31.804201 21340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:31.804477 21340 log.cc:824] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:31.805110 21340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc: No bootstrap required, opened a new log
I20260810 14:52:31.806759 21340 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } }
I20260810 14:52:31.806890 21340 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:31.806912 21340 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e46769d1cfd4e7fa58948189a85bbdc, State: Initialized, Role: FOLLOWER
I20260810 14:52:31.807047 21340 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } }
I20260810 14:52:31.807108 21340 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:31.807128 21340 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:31.807173 21340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:31.807662 21340 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } }
I20260810 14:52:31.807753 21340 leader_election.cc:302] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5e46769d1cfd4e7fa58948189a85bbdc; no voters:
I20260810 14:52:31.807897 21340 leader_election.cc:288] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:31.807933 21344 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:31.808082 21344 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [term 1 LEADER]: Becoming Leader. State: Replica: 5e46769d1cfd4e7fa58948189a85bbdc, State: Running, Role: LEADER
I20260810 14:52:31.808143 21340 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:31.808169 21344 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } }
I20260810 14:52:31.808516 21347 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e46769d1cfd4e7fa58948189a85bbdc. Latest consensus state: current_term: 1 leader_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } } }
I20260810 14:52:31.808631 21347 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:31.808660 21346 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5e46769d1cfd4e7fa58948189a85bbdc" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32875 } } }
I20260810 14:52:31.808753 21346 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:31.808856 21358 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:31.808957 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21230
I20260810 14:52:31.809083 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:31.809293 19575 external_mini_cluster.cc:1428] Setting key b6031bddff1a1a5dd645bfa05b37223e
I20260810 14:52:31.809386 21358 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:31.810990 21358 catalog_manager.cc:1347] Generated new cluster ID: 0257f4e50a4b42d7b9da509c3986cd72
I20260810 14:52:31.811046 21358 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21209](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373551, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:52:31.818732 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:31.809873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52879 (local address 127.0.0.1:32875)
0810 14:52:31.810403 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:31.810412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:31.810442 (+ 30us) server_negotiation.cc:407] Connection header received
0810 14:52:31.810545 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:31.810553 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:31.810612 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:31.810743 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:31.811437 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:31.812335 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:31.813038 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:31.813500 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:31.813594 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:31.815781 (+ 2187us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:31.815785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:31.815786 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:31.815796 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:31.817275 (+ 1479us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:31.817627 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:31.817630 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:31.817630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:31.817721 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:31.817922 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:31.817923 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:31.817923 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:31.818142 (+ 219us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:31.818320 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:31.818442 (+ 122us) server_negotiation.cc:299] Negotiation successful
0810 14:52:31.818553 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":54,"threads_started":1}
I20260810 14:52:31.819648 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:31.826243 21380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:31.820896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50493 (local address 127.0.0.1:32875)
0810 14:52:31.820930 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:31.820931 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:31.821027 (+ 96us) server_negotiation.cc:407] Connection header received
0810 14:52:31.821081 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:31.821081 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:31.821091 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:31.821130 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:31.821588 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:31.822049 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:31.822758 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:31.822983 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:31.823035 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:31.824039 (+ 1004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:31.824040 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:31.824041 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:31.824047 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:31.825227 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:31.825553 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:31.825554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:31.825554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:31.825605 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:31.825800 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:31.825801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:31.825801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:31.825902 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:31.825994 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:31.826109 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 14:52:31.826165 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:52:31.827432 21358 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:31.827891 21358 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:31.834276 21358 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5e46769d1cfd4e7fa58948189a85bbdc: Generated new TSK 0
I20260810 14:52:31.834460 21358 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:31.842120 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21230
W20260810 14:52:31.856509 21204 connection.cc:535] client connection to 127.0.0.1:32875 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32875): Connection reset by peer (error 104)
2026-08-10T14:52:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21393](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21393](info): set up 2 sockets
Aug 10 14:52:31 dist-test-slave-4tdj krb5kdc[21393](info): commencing operation
krb5kdc: starting...
W20260810 14:52:33.018222 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.149s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:33 dist-test-slave-4tdj krb5kdc[21393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373553, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:33.148653 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44123
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44123
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:33.229121 21407 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:33.229312 21407 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:33.229334 21407 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:33.230487 21407 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:33.230527 21407 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:33.230541 21407 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:33.230564 21407 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:33.230580 21407 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:33.232182 21407 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44123
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44123
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21407
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:33.232429 21407 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:33.232681 21407 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:33.237757 21415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:33.237844 21418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:33.237756 21413 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:33.237905 21407 server_base.cc:1034] running on GCE node
I20260810 14:52:33.238188 21407 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:33.238472 21407 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:33.239606 21407 hybrid_clock.cc:648] HybridClock initialized: now 1786373553239586 us; error 35 us; skew 500 ppm
Aug 10 14:52:33 dist-test-slave-4tdj krb5kdc[21393](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373553, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:33.241912 21407 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:33.242369 21407 webserver.cc:460] Webserver started at http://127.0.0.1:42967/ using document root <none> and password file <none>
I20260810 14:52:33.242570 21407 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:33.242616 21407 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:33.242738 21407 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:33.243741 21407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "351a6c5e9bc24b55834ae73e88c6f635"
format_stamp: "Formatted at 2026-08-10 14:52:33 on dist-test-slave-4tdj"
server_key: "ffd4f22b15d1ba55be19ba5d636f4fdb"
server_key_iv: "4a5dcc38b63b30c1e5604e9a214db7db"
server_key_version: "encryptionkey@0"
I20260810 14:52:33.244067 21407 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "351a6c5e9bc24b55834ae73e88c6f635"
format_stamp: "Formatted at 2026-08-10 14:52:33 on dist-test-slave-4tdj"
server_key: "ffd4f22b15d1ba55be19ba5d636f4fdb"
server_key_iv: "4a5dcc38b63b30c1e5604e9a214db7db"
server_key_version: "encryptionkey@0"
I20260810 14:52:33.245258 21407 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:33.245880 21428 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:33.246034 21407 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:33.246115 21407 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "351a6c5e9bc24b55834ae73e88c6f635"
format_stamp: "Formatted at 2026-08-10 14:52:33 on dist-test-slave-4tdj"
server_key: "ffd4f22b15d1ba55be19ba5d636f4fdb"
server_key_iv: "4a5dcc38b63b30c1e5604e9a214db7db"
server_key_version: "encryptionkey@0"
I20260810 14:52:33.246188 21407 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:33.259570 21407 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:33.261516 21407 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:33.261647 21407 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:33.265569 21407 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44123
I20260810 14:52:33.265607 21519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44123 every 8 connection(s)
I20260810 14:52:33.265915 21407 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:33.266834 21521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:33.269105 21521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635: Bootstrap starting.
I20260810 14:52:33.269647 21521 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:33.269891 21521 log.cc:824] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:33.270565 21521 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635: No bootstrap required, opened a new log
I20260810 14:52:33.272269 21521 raft_consensus.cc:348] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } }
I20260810 14:52:33.272411 21521 raft_consensus.cc:374] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:33.272432 21521 raft_consensus.cc:729] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 351a6c5e9bc24b55834ae73e88c6f635, State: Initialized, Role: FOLLOWER
I20260810 14:52:33.272539 21521 consensus_queue.cc:260] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } }
I20260810 14:52:33.272614 21521 raft_consensus.cc:388] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:33.272639 21521 raft_consensus.cc:482] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:33.272667 21521 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:33.273144 21521 raft_consensus.cc:504] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } }
I20260810 14:52:33.273229 21521 leader_election.cc:302] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 351a6c5e9bc24b55834ae73e88c6f635; no voters:
I20260810 14:52:33.273352 21521 leader_election.cc:288] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:33.273404 21524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:33.273571 21521 sys_catalog.cc:564] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:33.273556 21524 raft_consensus.cc:686] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [term 1 LEADER]: Becoming Leader. State: Replica: 351a6c5e9bc24b55834ae73e88c6f635, State: Running, Role: LEADER
I20260810 14:52:33.273690 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21407
I20260810 14:52:33.273701 21524 consensus_queue.cc:237] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } }
I20260810 14:52:33.273813 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:33.274013 19575 external_mini_cluster.cc:1428] Setting key d5fed8013ffb907f94339077494565f1
I20260810 14:52:33.274012 21524 sys_catalog.cc:455] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 351a6c5e9bc24b55834ae73e88c6f635. Latest consensus state: current_term: 1 leader_uuid: "351a6c5e9bc24b55834ae73e88c6f635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } } }
I20260810 14:52:33.274083 21524 sys_catalog.cc:458] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:33.274376 21525 sys_catalog.cc:455] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "351a6c5e9bc24b55834ae73e88c6f635" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "351a6c5e9bc24b55834ae73e88c6f635" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44123 } } }
I20260810 14:52:33.274446 21525 sys_catalog.cc:458] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:33.274557 21532 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:33.275259 21532 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:33.276813 21532 catalog_manager.cc:1347] Generated new cluster ID: 1b6e19f75c984d21a4c8b4fd0dadc55d
I20260810 14:52:33.276865 21532 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:33.280023 21544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:33.274654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44555 (local address 127.0.0.1:44123)
0810 14:52:33.274979 (+ 325us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:33.274989 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:33.275024 (+ 35us) server_negotiation.cc:407] Connection header received
0810 14:52:33.275158 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:33.275166 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:33.275222 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:33.275600 (+ 378us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:33.275681 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:33.276825 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:33.277925 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:33.278546 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:33.278640 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:33.279369 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:33.279373 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:33.279374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:33.279566 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:33.279603 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:33.279617 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:33.279690 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:33.279798 (+ 108us) server_negotiation.cc:299] Negotiation successful
0810 14:52:33.279823 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":65,"threads_started":1}
I20260810 14:52:33.280879 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:33.285815 21544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:33.282478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60039 (local address 127.0.0.1:44123)
0810 14:52:33.282508 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:33.282510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:33.282608 (+ 98us) server_negotiation.cc:407] Connection header received
0810 14:52:33.282678 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:33.282679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:33.282687 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:33.282736 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:33.282862 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:33.283594 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:33.284582 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:33.284877 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:33.284929 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:33.285587 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:33.285589 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:33.285589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:33.285593 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:33.285607 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:33.285611 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:33.285667 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:33.285736 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 14:52:33.285748 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260810 14:52:33.286350 21532 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:33.287011 21532 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:33.293213 21532 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 351a6c5e9bc24b55834ae73e88c6f635: Generated new TSK 0
I20260810 14:52:33.293380 21532 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:33.297706 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21407
W20260810 14:52:33.312849 21389 connection.cc:535] client connection to 127.0.0.1:44123 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44123): Connection reset by peer (error 104)
2026-08-10T14:52:33Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1456 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:33 dist-test-slave-4tdj krb5kdc[21560](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:33 dist-test-slave-4tdj krb5kdc[21560](info): set up 2 sockets
Aug 10 14:52:33 dist-test-slave-4tdj krb5kdc[21560](info): commencing operation
krb5kdc: starting...
W20260810 14:52:34.471391 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.145s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:34 dist-test-slave-4tdj krb5kdc[21560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373554, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:34.584697 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35855
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:34.664665 21578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:34.664862 21578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:34.664893 21578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:34.666049 21578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:34.666090 21578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:34.666108 21578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:34.666124 21578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:34.666141 21578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:34.667649 21578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35855
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21578
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:34.667896 21578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:34.668128 21578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:34.672860 21589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:34.672832 21585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:34.672885 21592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:34.672910 21578 server_base.cc:1034] running on GCE node
I20260810 14:52:34.673259 21578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:34.673525 21578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:34.674664 21578 hybrid_clock.cc:648] HybridClock initialized: now 1786373554674642 us; error 37 us; skew 500 ppm
Aug 10 14:52:34 dist-test-slave-4tdj krb5kdc[21560](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373554, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:34.676977 21578 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:34.677392 21578 webserver.cc:460] Webserver started at http://127.0.0.1:43295/ using document root <none> and password file <none>
I20260810 14:52:34.677613 21578 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:34.677659 21578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:34.677781 21578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:34.678805 21578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "d2c35130226b46ea922d33bd9660e708"
format_stamp: "Formatted at 2026-08-10 14:52:34 on dist-test-slave-4tdj"
server_key: "95d119ce6a0246268e591e2baed991a7"
server_key_iv: "1b79b305d177d6f156c2c08b598e7987"
server_key_version: "encryptionkey@0"
I20260810 14:52:34.679121 21578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "d2c35130226b46ea922d33bd9660e708"
format_stamp: "Formatted at 2026-08-10 14:52:34 on dist-test-slave-4tdj"
server_key: "95d119ce6a0246268e591e2baed991a7"
server_key_iv: "1b79b305d177d6f156c2c08b598e7987"
server_key_version: "encryptionkey@0"
I20260810 14:52:34.680320 21578 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:34.681047 21606 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:34.681198 21578 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:34.681284 21578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "d2c35130226b46ea922d33bd9660e708"
format_stamp: "Formatted at 2026-08-10 14:52:34 on dist-test-slave-4tdj"
server_key: "95d119ce6a0246268e591e2baed991a7"
server_key_iv: "1b79b305d177d6f156c2c08b598e7987"
server_key_version: "encryptionkey@0"
I20260810 14:52:34.681342 21578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:34.684506 21578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:34.686326 21578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:34.686458 21578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:34.690372 21578 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35855
I20260810 14:52:34.690414 21681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35855 every 8 connection(s)
I20260810 14:52:34.690716 21578 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:34.691718 21683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:34.694161 21683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708: Bootstrap starting.
I20260810 14:52:34.694759 21683 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:34.695022 21683 log.cc:824] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:34.695663 21683 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708: No bootstrap required, opened a new log
I20260810 14:52:34.697227 21683 raft_consensus.cc:348] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } }
I20260810 14:52:34.697363 21683 raft_consensus.cc:374] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:34.697388 21683 raft_consensus.cc:729] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2c35130226b46ea922d33bd9660e708, State: Initialized, Role: FOLLOWER
I20260810 14:52:34.697489 21683 consensus_queue.cc:260] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } }
I20260810 14:52:34.697546 21683 raft_consensus.cc:388] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:34.697566 21683 raft_consensus.cc:482] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:34.697599 21683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:34.698108 21683 raft_consensus.cc:504] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } }
I20260810 14:52:34.698199 21683 leader_election.cc:302] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2c35130226b46ea922d33bd9660e708; no voters:
I20260810 14:52:34.698354 21683 leader_election.cc:288] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:34.698385 21689 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:34.698570 21689 raft_consensus.cc:686] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [term 1 LEADER]: Becoming Leader. State: Replica: d2c35130226b46ea922d33bd9660e708, State: Running, Role: LEADER
I20260810 14:52:34.698609 21683 sys_catalog.cc:564] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:34.698660 21689 consensus_queue.cc:237] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } }
I20260810 14:52:34.699121 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21578
I20260810 14:52:34.699132 21692 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2c35130226b46ea922d33bd9660e708. Latest consensus state: current_term: 1 leader_uuid: "d2c35130226b46ea922d33bd9660e708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } } }
I20260810 14:52:34.699219 21692 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:34.699251 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:34.699254 21690 sys_catalog.cc:455] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2c35130226b46ea922d33bd9660e708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2c35130226b46ea922d33bd9660e708" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35855 } } }
I20260810 14:52:34.699326 21690 sys_catalog.cc:458] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:34.699450 19575 external_mini_cluster.cc:1428] Setting key bffb33e440286c0ca473340184f3bb8d
I20260810 14:52:34.700129 21696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:34.700752 21696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:34.702404 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:34.699942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40041 (local address 127.0.0.1:35855)
0810 14:52:34.700151 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:34.700160 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:34.700194 (+ 34us) server_negotiation.cc:407] Connection header received
0810 14:52:34.700310 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:34.700316 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:34.700356 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:34.700515 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:34.701876 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:34.701880 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:34.701880 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:34.701885 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:34.701935 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:34.701952 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:34.702038 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:34.702154 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 14:52:34.702197 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260810 14:52:34.702643 21696 catalog_manager.cc:1347] Generated new cluster ID: 4f83f19f47cc4b579e923baa8c1c910c
I20260810 14:52:34.702708 21696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:34.703336 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:34.707336 21711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:34.704848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58701 (local address 127.0.0.1:35855)
0810 14:52:34.704880 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:34.704882 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:34.706432 (+ 1550us) server_negotiation.cc:407] Connection header received
0810 14:52:34.706494 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:34.706495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:34.706501 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:34.706563 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:34.707117 (+ 554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:34.707119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:34.707119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:34.707124 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:34.707141 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:34.707146 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:34.707201 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:34.707260 (+ 59us) server_negotiation.cc:299] Negotiation successful
0810 14:52:34.707274 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:34.713753 21696 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:34.713899 21696 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:34.731235 21696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d2c35130226b46ea922d33bd9660e708: Generated new TSK 0
I20260810 14:52:34.731406 21696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:34.735440 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21578
2026-08-10T14:52:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1439 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:34 dist-test-slave-4tdj krb5kdc[21728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:34 dist-test-slave-4tdj krb5kdc[21728](info): set up 2 sockets
Aug 10 14:52:34 dist-test-slave-4tdj krb5kdc[21728](info): commencing operation
krb5kdc: starting...
W20260810 14:52:35.898815 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:35 dist-test-slave-4tdj krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:36.010726 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38847
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38847
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:36.089648 21749 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:36.089834 21749 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:36.089855 21749 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:36.090945 21749 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:36.090977 21749 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:36.090991 21749 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:36.091001 21749 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:36.091012 21749 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:36.092392 21749 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38847
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38847
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21749
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:36.092577 21749 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:36.092736 21749 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:36.097304 21756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:36.097410 21749 server_base.cc:1034] running on GCE node
W20260810 14:52:36.097424 21759 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:36.097306 21755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:36.097733 21749 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:36.097980 21749 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:36.099144 21749 hybrid_clock.cc:648] HybridClock initialized: now 1786373556099131 us; error 30 us; skew 500 ppm
Aug 10 14:52:36 dist-test-slave-4tdj krb5kdc[21728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373556, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:36.101497 21749 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:36.101895 21749 webserver.cc:460] Webserver started at http://127.0.0.1:33513/ using document root <none> and password file <none>
I20260810 14:52:36.102070 21749 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:36.102108 21749 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:36.102197 21749 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:36.103183 21749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "f18123f5b204468e812c4a1c308a4fd9"
format_stamp: "Formatted at 2026-08-10 14:52:36 on dist-test-slave-4tdj"
server_key: "23176a5f93e95291217914231ecee5f9"
server_key_iv: "a4ab549b8b4103fcdcb880caee0a34d9"
server_key_version: "encryptionkey@0"
I20260810 14:52:36.103464 21749 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "f18123f5b204468e812c4a1c308a4fd9"
format_stamp: "Formatted at 2026-08-10 14:52:36 on dist-test-slave-4tdj"
server_key: "23176a5f93e95291217914231ecee5f9"
server_key_iv: "a4ab549b8b4103fcdcb880caee0a34d9"
server_key_version: "encryptionkey@0"
I20260810 14:52:36.104678 21749 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:36.105463 21769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:36.105675 21749 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:36.105773 21749 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "f18123f5b204468e812c4a1c308a4fd9"
format_stamp: "Formatted at 2026-08-10 14:52:36 on dist-test-slave-4tdj"
server_key: "23176a5f93e95291217914231ecee5f9"
server_key_iv: "a4ab549b8b4103fcdcb880caee0a34d9"
server_key_version: "encryptionkey@0"
I20260810 14:52:36.105834 21749 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:36.127170 21749 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:36.128835 21749 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:36.128988 21749 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:36.132833 21749 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38847
I20260810 14:52:36.132885 21851 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38847 every 8 connection(s)
I20260810 14:52:36.133208 21749 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:36.134022 21852 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:36.135169 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21749
I20260810 14:52:36.135278 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:36.135430 19575 external_mini_cluster.cc:1428] Setting key 093d4075b9c378bb0b533e0934e4cfd3
I20260810 14:52:36.136771 21852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9: Bootstrap starting.
I20260810 14:52:36.137379 21852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:36.137681 21852 log.cc:824] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:36.138428 21852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9: No bootstrap required, opened a new log
I20260810 14:52:36.140517 21852 raft_consensus.cc:348] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260810 14:52:36.140648 21852 raft_consensus.cc:374] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:36.140679 21852 raft_consensus.cc:729] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f18123f5b204468e812c4a1c308a4fd9, State: Initialized, Role: FOLLOWER
I20260810 14:52:36.140795 21852 consensus_queue.cc:260] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260810 14:52:36.140856 21852 raft_consensus.cc:388] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:36.140885 21852 raft_consensus.cc:482] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:36.140930 21852 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:36.141438 21852 raft_consensus.cc:504] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
I20260810 14:52:36.141530 21852 leader_election.cc:302] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f18123f5b204468e812c4a1c308a4fd9; no voters:
I20260810 14:52:36.141686 21852 leader_election.cc:288] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:36.141723 21859 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:36.141831 21859 raft_consensus.cc:686] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [term 1 LEADER]: Becoming Leader. State: Replica: f18123f5b204468e812c4a1c308a4fd9, State: Running, Role: LEADER
I20260810 14:52:36.141943 21852 sys_catalog.cc:564] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:36.141973 21859 consensus_queue.cc:237] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } }
Aug 10 14:52:36 dist-test-slave-4tdj krb5kdc[21728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373555, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:52:36.142329 21859 sys_catalog.cc:455] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f18123f5b204468e812c4a1c308a4fd9. Latest consensus state: current_term: 1 leader_uuid: "f18123f5b204468e812c4a1c308a4fd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } } }
I20260810 14:52:36.142408 21859 sys_catalog.cc:458] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:36.142650 21860 sys_catalog.cc:455] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f18123f5b204468e812c4a1c308a4fd9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f18123f5b204468e812c4a1c308a4fd9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38847 } } }
I20260810 14:52:36.142750 21860 sys_catalog.cc:458] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:36.142674 21868 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:36.143430 21868 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:36.144999 21868 catalog_manager.cc:1347] Generated new cluster ID: a5d71516af0242c388ae3d0307869fc6
I20260810 14:52:36.145061 21868 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:36.145929 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:36.135902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58659 (local address 127.0.0.1:38847)
0810 14:52:36.136089 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:36.136099 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:36.136132 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:52:36.136659 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:36.136668 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:36.136729 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:36.136878 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:36.137491 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:36.138801 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:36.139511 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:36.140132 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:36.140253 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:36.142634 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:36.142639 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:36.142639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:36.142652 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:36.144543 (+ 1891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:36.144858 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:36.144861 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:36.144861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:36.144981 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:36.145162 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:36.145163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:36.145163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:36.145406 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:36.145526 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:36.145645 (+ 119us) server_negotiation.cc:299] Negotiation successful
0810 14:52:36.145777 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
I20260810 14:52:36.146867 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:36.155602 21855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:36.148123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47261 (local address 127.0.0.1:38847)
0810 14:52:36.148162 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:36.148164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:36.150456 (+ 2292us) server_negotiation.cc:407] Connection header received
0810 14:52:36.150509 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:36.150510 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:36.150521 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:36.150573 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:36.151031 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:36.151507 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:36.152158 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:36.152371 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:36.152423 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:36.153433 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:36.153435 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:36.153435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:36.153441 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:36.154664 (+ 1223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:36.154948 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:36.154949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:36.154950 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:36.155000 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:36.155159 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:36.155160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:36.155160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:36.155261 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:36.155341 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:36.155446 (+ 105us) server_negotiation.cc:299] Negotiation successful
0810 14:52:36.155519 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:36.185516 21868 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:36.186334 21868 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:36.192309 21868 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f18123f5b204468e812c4a1c308a4fd9: Generated new TSK 0
I20260810 14:52:36.192499 21868 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:36.196514 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21749
2026-08-10T14:52:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1464 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:36 dist-test-slave-4tdj krb5kdc[21899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:36 dist-test-slave-4tdj krb5kdc[21899](info): set up 2 sockets
Aug 10 14:52:36 dist-test-slave-4tdj krb5kdc[21899](info): commencing operation
krb5kdc: starting...
W20260810 14:52:37.363713 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:37 dist-test-slave-4tdj krb5kdc[21899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373557, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:37.477380 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39901
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42765
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39901
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:37.556315 21918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:37.556499 21918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:37.556528 21918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:37.557613 21918 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:37.557653 21918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:37.557672 21918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:37.557688 21918 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:37.557703 21918 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:37.559145 21918 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42765
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39901
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39901
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:37.559376 21918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:37.559566 21918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:37.564098 21928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:37.564139 21926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:37.564217 21924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:37.564325 21918 server_base.cc:1034] running on GCE node
I20260810 14:52:37.564570 21918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:37.564821 21918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:37.565959 21918 hybrid_clock.cc:648] HybridClock initialized: now 1786373557565937 us; error 38 us; skew 500 ppm
Aug 10 14:52:37 dist-test-slave-4tdj krb5kdc[21899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373557, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:37.572881 21918 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:37.573267 21918 webserver.cc:460] Webserver started at http://127.0.0.1:35995/ using document root <none> and password file <none>
I20260810 14:52:37.573451 21918 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:37.573495 21918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:37.573582 21918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:37.574566 21918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "618199cb1e5647acba28ac63e4e1f792"
format_stamp: "Formatted at 2026-08-10 14:52:37 on dist-test-slave-4tdj"
server_key: "3701dca936c5990835f27ae21e09351c"
server_key_iv: "8a03e2085a554f599188fe58f169d1f4"
server_key_version: "encryptionkey@0"
I20260810 14:52:37.574852 21918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "618199cb1e5647acba28ac63e4e1f792"
format_stamp: "Formatted at 2026-08-10 14:52:37 on dist-test-slave-4tdj"
server_key: "3701dca936c5990835f27ae21e09351c"
server_key_iv: "8a03e2085a554f599188fe58f169d1f4"
server_key_version: "encryptionkey@0"
I20260810 14:52:37.576010 21918 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260810 14:52:37.576642 21941 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:37.576803 21918 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:37.576871 21918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "618199cb1e5647acba28ac63e4e1f792"
format_stamp: "Formatted at 2026-08-10 14:52:37 on dist-test-slave-4tdj"
server_key: "3701dca936c5990835f27ae21e09351c"
server_key_iv: "8a03e2085a554f599188fe58f169d1f4"
server_key_version: "encryptionkey@0"
I20260810 14:52:37.576921 21918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:37.589947 21918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:37.591722 21918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:37.591822 21918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:37.595463 21918 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39901
I20260810 14:52:37.595503 22011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39901 every 8 connection(s)
I20260810 14:52:37.595794 21918 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:37.596613 22012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:37.598852 22012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792: Bootstrap starting.
I20260810 14:52:37.599399 22012 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:37.599653 22012 log.cc:824] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:37.600271 22012 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792: No bootstrap required, opened a new log
I20260810 14:52:37.601572 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 21918
I20260810 14:52:37.601676 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:37.601833 19575 external_mini_cluster.cc:1428] Setting key 1d2bf6831cefb3221fd850c834231f36
I20260810 14:52:37.601842 22012 raft_consensus.cc:348] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } }
I20260810 14:52:37.602013 22012 raft_consensus.cc:374] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:37.602062 22012 raft_consensus.cc:729] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 618199cb1e5647acba28ac63e4e1f792, State: Initialized, Role: FOLLOWER
I20260810 14:52:37.602205 22012 consensus_queue.cc:260] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } }
I20260810 14:52:37.602316 22012 raft_consensus.cc:388] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:37.602391 22012 raft_consensus.cc:482] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:37.602448 22012 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:37.603420 22012 raft_consensus.cc:504] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } }
I20260810 14:52:37.603526 22012 leader_election.cc:302] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 618199cb1e5647acba28ac63e4e1f792; no voters:
I20260810 14:52:37.603684 22012 leader_election.cc:288] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:37.603727 22021 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:37.603855 22021 raft_consensus.cc:686] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [term 1 LEADER]: Becoming Leader. State: Replica: 618199cb1e5647acba28ac63e4e1f792, State: Running, Role: LEADER
I20260810 14:52:37.603906 22012 sys_catalog.cc:564] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:37.603979 22021 consensus_queue.cc:237] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } }
I20260810 14:52:37.604336 22021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 618199cb1e5647acba28ac63e4e1f792. Latest consensus state: current_term: 1 leader_uuid: "618199cb1e5647acba28ac63e4e1f792" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } } }
I20260810 14:52:37.604490 22021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:37.604768 22032 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:37.605274 22032 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:37.604507 22023 sys_catalog.cc:455] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "618199cb1e5647acba28ac63e4e1f792" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "618199cb1e5647acba28ac63e4e1f792" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39901 } } }
I20260810 14:52:37.605441 22023 sys_catalog.cc:458] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:37.607414 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:37.602468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48737 (local address 127.0.0.1:39901)
0810 14:52:37.602680 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:37.602689 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:37.602722 (+ 33us) server_negotiation.cc:407] Connection header received
0810 14:52:37.602849 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:37.602857 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:37.602912 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:37.603061 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:37.603232 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:37.604538 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:37.605381 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:37.605958 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:37.606056 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:37.606690 (+ 634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:37.606694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:37.606695 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:37.606875 (+ 180us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:37.606903 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:37.606914 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:37.606970 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:37.607151 (+ 181us) server_negotiation.cc:299] Negotiation successful
0810 14:52:37.607210 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
I20260810 14:52:37.607897 22032 catalog_manager.cc:1347] Generated new cluster ID: c78390a216b740e5aebe9b0a04cc12d0
I20260810 14:52:37.607950 22032 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:37.608283 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:37.616168 22032 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:37.616664 22032 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:37.619292 22019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:37.614739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43435 (local address 127.0.0.1:39901)
0810 14:52:37.614777 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:37.614778 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:37.616023 (+ 1245us) server_negotiation.cc:407] Connection header received
0810 14:52:37.616174 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:37.616175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:37.616185 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:37.616233 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:37.616401 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:37.617130 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:37.618095 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:37.618414 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:37.618493 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:37.619058 (+ 565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:37.619059 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:37.619060 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:37.619065 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:37.619080 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:37.619084 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:37.619132 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:37.619182 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:52:37.619221 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:52:37.628584 22032 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 618199cb1e5647acba28ac63e4e1f792: Generated new TSK 0
I20260810 14:52:37.628751 22032 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:37.630527 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 21918
2026-08-10T14:52:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1428 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:37 dist-test-slave-4tdj krb5kdc[22056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:37 dist-test-slave-4tdj krb5kdc[22056](info): set up 2 sockets
Aug 10 14:52:37 dist-test-slave-4tdj krb5kdc[22056](info): commencing operation
krb5kdc: starting...
W20260810 14:52:38.788069 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:38 dist-test-slave-4tdj krb5kdc[22056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373558, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:38.899585 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42659
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42659
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:38.980360 22077 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:38.980548 22077 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:38.980569 22077 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:38.981640 22077 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:38.981674 22077 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:38.981686 22077 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:38.981698 22077 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:38.981707 22077 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:38.983177 22077 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42659
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42659
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22077
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:38.983368 22077 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:38.983534 22077 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:38.988116 22083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:38.988158 22088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:38.988229 22084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:38.988235 22077 server_base.cc:1034] running on GCE node
I20260810 14:52:38.988575 22077 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:38.988828 22077 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:38.989960 22077 hybrid_clock.cc:648] HybridClock initialized: now 1786373558989945 us; error 33 us; skew 500 ppm
Aug 10 14:52:38 dist-test-slave-4tdj krb5kdc[22056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373558, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:38.992298 22077 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:38.992663 22077 webserver.cc:460] Webserver started at http://127.0.0.1:43599/ using document root <none> and password file <none>
I20260810 14:52:38.992835 22077 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:38.992873 22077 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:38.992960 22077 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:38.993916 22077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "fbf40a6e572449578507bc0f9f3d1956"
format_stamp: "Formatted at 2026-08-10 14:52:38 on dist-test-slave-4tdj"
server_key: "46ce1b03188da6277d33256459e18d9d"
server_key_iv: "bec7d4df55faf45571fabb09fb19d9ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:38.994197 22077 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "fbf40a6e572449578507bc0f9f3d1956"
format_stamp: "Formatted at 2026-08-10 14:52:38 on dist-test-slave-4tdj"
server_key: "46ce1b03188da6277d33256459e18d9d"
server_key_iv: "bec7d4df55faf45571fabb09fb19d9ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:38.995379 22077 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:38.995997 22097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:38.996151 22077 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:38.996232 22077 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "fbf40a6e572449578507bc0f9f3d1956"
format_stamp: "Formatted at 2026-08-10 14:52:38 on dist-test-slave-4tdj"
server_key: "46ce1b03188da6277d33256459e18d9d"
server_key_iv: "bec7d4df55faf45571fabb09fb19d9ea"
server_key_version: "encryptionkey@0"
I20260810 14:52:38.996289 22077 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:38.999403 22077 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:39.001379 22077 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:39.001508 22077 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:39.005338 22077 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42659
I20260810 14:52:39.005380 22175 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42659 every 8 connection(s)
I20260810 14:52:39.005674 22077 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:39.006749 22177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:39.008894 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956: Bootstrap starting.
I20260810 14:52:39.009405 22177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:39.009642 22177 log.cc:824] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:39.010314 22177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956: No bootstrap required, opened a new log
I20260810 14:52:39.011863 22177 raft_consensus.cc:348] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } }
I20260810 14:52:39.011993 22177 raft_consensus.cc:374] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:39.012014 22177 raft_consensus.cc:729] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbf40a6e572449578507bc0f9f3d1956, State: Initialized, Role: FOLLOWER
I20260810 14:52:39.012120 22177 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } }
I20260810 14:52:39.012197 22177 raft_consensus.cc:388] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:39.012218 22177 raft_consensus.cc:482] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:39.012244 22177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:39.012727 22177 raft_consensus.cc:504] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } }
I20260810 14:52:39.012809 22177 leader_election.cc:302] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbf40a6e572449578507bc0f9f3d1956; no voters:
I20260810 14:52:39.012925 22177 leader_election.cc:288] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:39.013031 22180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:39.013146 22177 sys_catalog.cc:564] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:39.013207 22180 raft_consensus.cc:686] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [term 1 LEADER]: Becoming Leader. State: Replica: fbf40a6e572449578507bc0f9f3d1956, State: Running, Role: LEADER
I20260810 14:52:39.013303 22180 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } }
I20260810 14:52:39.013898 22181 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbf40a6e572449578507bc0f9f3d1956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } } }
I20260810 14:52:39.013885 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbf40a6e572449578507bc0f9f3d1956. Latest consensus state: current_term: 1 leader_uuid: "fbf40a6e572449578507bc0f9f3d1956" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbf40a6e572449578507bc0f9f3d1956" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42659 } } }
I20260810 14:52:39.013991 22181 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:39.013998 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:39.014371 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22077
I20260810 14:52:39.014407 22193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:39.014495 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:39.014703 19575 external_mini_cluster.cc:1428] Setting key 6ce4312932a78c0d57190f4e73cba7b7
I20260810 14:52:39.014816 22193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:39.016880 22193 catalog_manager.cc:1347] Generated new cluster ID: 284ff8561c044d8dabee1f1405d79081
I20260810 14:52:39.016937 22193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:39.017468 22205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:39.015351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54325 (local address 127.0.0.1:42659)
0810 14:52:39.015514 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:39.015523 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:39.015605 (+ 82us) server_negotiation.cc:407] Connection header received
0810 14:52:39.015834 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:39.015839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:39.015869 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:39.016000 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:39.016941 (+ 941us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:39.016945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:39.016945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:39.016950 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:39.016991 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:39.017005 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:39.017245 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:39.017272 (+ 27us) server_negotiation.cc:299] Negotiation successful
0810 14:52:39.017309 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":67,"threads_started":1}
I20260810 14:52:39.018319 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:39.030718 22193 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:39.030866 22193 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:39.031342 22205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:39.026607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53743 (local address 127.0.0.1:42659)
0810 14:52:39.026641 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:39.026642 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:39.030321 (+ 3679us) server_negotiation.cc:407] Connection header received
0810 14:52:39.030405 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:39.030406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:39.030413 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:39.030444 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:39.031114 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:39.031116 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:39.031116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:39.031121 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:39.031140 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:39.031146 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:39.031211 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:39.031261 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:52:39.031274 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:39.038792 22193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fbf40a6e572449578507bc0f9f3d1956: Generated new TSK 0
I20260810 14:52:39.038960 22193 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:39.044090 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22077
2026-08-10T14:52:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:39 dist-test-slave-4tdj krb5kdc[22221](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:39 dist-test-slave-4tdj krb5kdc[22221](info): set up 2 sockets
Aug 10 14:52:39 dist-test-slave-4tdj krb5kdc[22221](info): commencing operation
krb5kdc: starting...
W20260810 14:52:40.220639 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.143s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:40.334825 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37885
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33691
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37885
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:40.414491 22238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:40.414678 22238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:40.414700 22238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:40.415812 22238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:40.415850 22238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:40.415863 22238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:40.415885 22238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:40.415901 22238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:40.417363 22238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33691
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37885
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22238
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:40.417587 22238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:40.417793 22238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:40.422386 22246 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:40.422397 22245 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:40.422467 22238 server_base.cc:1034] running on GCE node
W20260810 14:52:40.422417 22248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:40.422821 22238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:40.423086 22238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:40.424225 22238 hybrid_clock.cc:648] HybridClock initialized: now 1786373560424209 us; error 34 us; skew 500 ppm
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22221](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373560, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:40.426584 22238 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:40.426966 22238 webserver.cc:460] Webserver started at http://127.0.0.1:35101/ using document root <none> and password file <none>
I20260810 14:52:40.427166 22238 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:40.427212 22238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:40.427331 22238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:40.428298 22238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "ea95baa3a93c4b86bd211ce56cc5423c"
format_stamp: "Formatted at 2026-08-10 14:52:40 on dist-test-slave-4tdj"
server_key: "d25e120e32d9cca99500b02bd73f397f"
server_key_iv: "b64edbb495c2e4119e03d4b5d29cb948"
server_key_version: "encryptionkey@0"
I20260810 14:52:40.428602 22238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "ea95baa3a93c4b86bd211ce56cc5423c"
format_stamp: "Formatted at 2026-08-10 14:52:40 on dist-test-slave-4tdj"
server_key: "d25e120e32d9cca99500b02bd73f397f"
server_key_iv: "b64edbb495c2e4119e03d4b5d29cb948"
server_key_version: "encryptionkey@0"
I20260810 14:52:40.429826 22238 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260810 14:52:40.430539 22258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:40.430684 22238 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:40.430768 22238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "ea95baa3a93c4b86bd211ce56cc5423c"
format_stamp: "Formatted at 2026-08-10 14:52:40 on dist-test-slave-4tdj"
server_key: "d25e120e32d9cca99500b02bd73f397f"
server_key_iv: "b64edbb495c2e4119e03d4b5d29cb948"
server_key_version: "encryptionkey@0"
I20260810 14:52:40.430824 22238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:40.450543 22238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:40.452422 22238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:40.452548 22238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:40.456228 22238 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37885
I20260810 14:52:40.456267 22339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37885 every 8 connection(s)
I20260810 14:52:40.456573 22238 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:40.457393 22341 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:40.459558 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22238
I20260810 14:52:40.459631 22341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c: Bootstrap starting.
I20260810 14:52:40.459679 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:40.459841 19575 external_mini_cluster.cc:1428] Setting key f874382418f3e683bf2a9a01fd151355
I20260810 14:52:40.460219 22341 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:40.460556 22341 log.cc:824] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:40.461215 22341 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c: No bootstrap required, opened a new log
I20260810 14:52:40.463367 22341 raft_consensus.cc:348] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260810 14:52:40.463538 22341 raft_consensus.cc:374] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:40.463569 22341 raft_consensus.cc:729] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea95baa3a93c4b86bd211ce56cc5423c, State: Initialized, Role: FOLLOWER
I20260810 14:52:40.463686 22341 consensus_queue.cc:260] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260810 14:52:40.463758 22341 raft_consensus.cc:388] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:40.463845 22341 raft_consensus.cc:482] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:40.463896 22341 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:40.464453 22341 raft_consensus.cc:504] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260810 14:52:40.464581 22341 leader_election.cc:302] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ea95baa3a93c4b86bd211ce56cc5423c; no voters:
I20260810 14:52:40.464728 22341 leader_election.cc:288] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:40.464857 22346 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:40.464975 22341 sys_catalog.cc:564] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:40.465001 22346 raft_consensus.cc:686] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [term 1 LEADER]: Becoming Leader. State: Replica: ea95baa3a93c4b86bd211ce56cc5423c, State: Running, Role: LEADER
I20260810 14:52:40.465114 22346 consensus_queue.cc:237] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } }
I20260810 14:52:40.465453 22346 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [sys.catalog]: SysCatalogTable state changed. Reason: New leader ea95baa3a93c4b86bd211ce56cc5423c. Latest consensus state: current_term: 1 leader_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } } }
I20260810 14:52:40.465624 22346 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:40.465569 22347 sys_catalog.cc:455] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ea95baa3a93c4b86bd211ce56cc5423c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37885 } } }
I20260810 14:52:40.465823 22347 sys_catalog.cc:458] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c [sys.catalog]: This master's current role is: LEADER
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22221](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373560, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:52:40.466490 22361 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:40.466953 22361 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:40.468592 22361 catalog_manager.cc:1347] Generated new cluster ID: f2dd4122b6bb48b48b775b309c13fa2c
I20260810 14:52:40.468658 22361 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:40.470355 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:40.460389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:58713 (local address 127.0.0.1:37885)
0810 14:52:40.460545 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:40.460554 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:40.460580 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:52:40.461005 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:40.461011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:40.461057 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:40.461182 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:40.461869 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:40.462784 (+ 915us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:40.463795 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:40.464243 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:40.464324 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:40.466948 (+ 2624us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:40.466952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:40.466952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:40.466964 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:40.468923 (+ 1959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:40.469275 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:40.469278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:40.469279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:40.469361 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:40.469553 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:40.469554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:40.469554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:40.469779 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:40.469908 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:40.470031 (+ 123us) server_negotiation.cc:299] Negotiation successful
0810 14:52:40.470123 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":58,"threads_started":1}
I20260810 14:52:40.471220 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:40.478754 22361 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:40.479430 22361 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:40.482101 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:40.474532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:43623 (local address 127.0.0.1:37885)
0810 14:52:40.474563 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:40.474565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:40.476395 (+ 1830us) server_negotiation.cc:407] Connection header received
0810 14:52:40.476449 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:40.476450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:40.476460 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:40.476505 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:40.476951 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:40.477777 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:40.478527 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:40.478749 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:40.478797 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:40.479905 (+ 1108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:40.479906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:40.479907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:40.479913 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:40.481113 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:40.481433 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:40.481434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:40.481434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:40.481485 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:40.481672 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:40.481673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:40.481673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:40.481771 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:40.481853 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:40.481968 (+ 115us) server_negotiation.cc:299] Negotiation successful
0810 14:52:40.482023 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":300,"server-negotiator.queue_time_us":16}
I20260810 14:52:40.486425 22361 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ea95baa3a93c4b86bd211ce56cc5423c: Generated new TSK 0
I20260810 14:52:40.486590 22361 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:40.490531 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22238
W20260810 14:52:40.499377 22216 connection.cc:535] client connection to 127.0.0.1:37885 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37885): Connection reset by peer (error 104)
2026-08-10T14:52:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1435 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22389](info): set up 2 sockets
Aug 10 14:52:40 dist-test-slave-4tdj krb5kdc[22389](info): commencing operation
krb5kdc: starting...
W20260810 14:52:41.648659 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:41 dist-test-slave-4tdj krb5kdc[22389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373561, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:41.763382 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34279
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34279
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:41.843312 22405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:41.843509 22405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:41.843549 22405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:41.844672 22405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:41.844712 22405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:41.844731 22405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:41.844748 22405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:41.844764 22405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:41.846252 22405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34279
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34279
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22405
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:41.846529 22405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:41.846732 22405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:41.851364 22412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:41.851346 22411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:41.851346 22416 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:41.851526 22405 server_base.cc:1034] running on GCE node
I20260810 14:52:41.851848 22405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:41.852126 22405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:41.853258 22405 hybrid_clock.cc:648] HybridClock initialized: now 1786373561853250 us; error 27 us; skew 500 ppm
Aug 10 14:52:41 dist-test-slave-4tdj krb5kdc[22389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373561, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:41.855566 22405 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:41.855970 22405 webserver.cc:460] Webserver started at http://127.0.0.1:39285/ using document root <none> and password file <none>
I20260810 14:52:41.856189 22405 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:41.856236 22405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:41.856360 22405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:41.857331 22405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "c37f44ff013b49ad96c3c7b363d5989a"
format_stamp: "Formatted at 2026-08-10 14:52:41 on dist-test-slave-4tdj"
server_key: "19e9173335f5a3d8f95560ffdf261bf8"
server_key_iv: "24bc25b557fcd615bbbee12e2ee74481"
server_key_version: "encryptionkey@0"
I20260810 14:52:41.857648 22405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "c37f44ff013b49ad96c3c7b363d5989a"
format_stamp: "Formatted at 2026-08-10 14:52:41 on dist-test-slave-4tdj"
server_key: "19e9173335f5a3d8f95560ffdf261bf8"
server_key_iv: "24bc25b557fcd615bbbee12e2ee74481"
server_key_version: "encryptionkey@0"
I20260810 14:52:41.858906 22405 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260810 14:52:41.859543 22424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:41.859721 22405 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:41.859809 22405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "c37f44ff013b49ad96c3c7b363d5989a"
format_stamp: "Formatted at 2026-08-10 14:52:41 on dist-test-slave-4tdj"
server_key: "19e9173335f5a3d8f95560ffdf261bf8"
server_key_iv: "24bc25b557fcd615bbbee12e2ee74481"
server_key_version: "encryptionkey@0"
I20260810 14:52:41.859865 22405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:41.868875 22405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:41.870843 22405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:41.870970 22405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:41.874914 22405 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34279
I20260810 14:52:41.874955 22504 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34279 every 8 connection(s)
I20260810 14:52:41.875288 22405 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:41.876086 22505 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:41.877405 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22405
I20260810 14:52:41.877519 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:41.877681 19575 external_mini_cluster.cc:1428] Setting key 33c33d191fdf89f2d37f4ad5f50c31d2
I20260810 14:52:41.878471 22505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a: Bootstrap starting.
I20260810 14:52:41.879014 22505 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:41.879299 22505 log.cc:824] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:41.880060 22505 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a: No bootstrap required, opened a new log
I20260810 14:52:41.881861 22505 raft_consensus.cc:348] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } }
I20260810 14:52:41.882010 22505 raft_consensus.cc:374] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:41.882048 22505 raft_consensus.cc:729] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c37f44ff013b49ad96c3c7b363d5989a, State: Initialized, Role: FOLLOWER
I20260810 14:52:41.882176 22505 consensus_queue.cc:260] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } }
I20260810 14:52:41.882261 22505 raft_consensus.cc:388] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:41.882318 22505 raft_consensus.cc:482] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:41.882372 22505 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:41.882910 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:41.878166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:52485 (local address 127.0.0.1:34279)
0810 14:52:41.878372 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:41.878382 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:41.878408 (+ 26us) server_negotiation.cc:407] Connection header received
0810 14:52:41.878843 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:41.878850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:41.878899 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:41.879032 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:41.879234 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:41.880343 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:41.881097 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:41.881495 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:41.881590 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:41.882216 (+ 626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:41.882220 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:41.882221 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:41.882435 (+ 214us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:41.882476 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:41.882490 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:41.882570 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:41.882653 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 14:52:41.882768 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":80,"threads_started":1}
I20260810 14:52:41.882939 22505 raft_consensus.cc:504] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } }
I20260810 14:52:41.883059 22505 leader_election.cc:302] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c37f44ff013b49ad96c3c7b363d5989a; no voters:
I20260810 14:52:41.883237 22505 leader_election.cc:288] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:41.883296 22510 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:41.883422 22510 raft_consensus.cc:686] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [term 1 LEADER]: Becoming Leader. State: Replica: c37f44ff013b49ad96c3c7b363d5989a, State: Running, Role: LEADER
I20260810 14:52:41.883497 22505 sys_catalog.cc:564] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:41.883512 22510 consensus_queue.cc:237] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } }
I20260810 14:52:41.883716 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:41.883882 22510 sys_catalog.cc:455] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c37f44ff013b49ad96c3c7b363d5989a. Latest consensus state: current_term: 1 leader_uuid: "c37f44ff013b49ad96c3c7b363d5989a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } } }
I20260810 14:52:41.883891 22512 sys_catalog.cc:455] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c37f44ff013b49ad96c3c7b363d5989a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c37f44ff013b49ad96c3c7b363d5989a" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34279 } } }
I20260810 14:52:41.884027 22512 sys_catalog.cc:458] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:41.884194 22510 sys_catalog.cc:458] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:41.884238 22523 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:41.884773 22523 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:41.886696 22523 catalog_manager.cc:1347] Generated new cluster ID: 67e1d722233e476fbc7fb7daa6f2dde0
I20260810 14:52:41.886780 22523 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:41.888693 22508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:41.885283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:39811 (local address 127.0.0.1:34279)
0810 14:52:41.885314 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:41.885316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:41.885544 (+ 228us) server_negotiation.cc:407] Connection header received
0810 14:52:41.885618 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:41.885618 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:41.885629 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:41.885676 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:41.885836 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:41.886466 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:41.887429 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:41.887743 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:41.887837 (+ 94us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:41.888456 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:41.888458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:41.888458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:41.888463 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:41.888479 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:41.888484 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:41.888556 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:41.888611 (+ 55us) server_negotiation.cc:299] Negotiation successful
0810 14:52:41.888623 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:41.907152 22523 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:41.907660 22523 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:41.914237 22523 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c37f44ff013b49ad96c3c7b363d5989a: Generated new TSK 0
I20260810 14:52:41.914420 22523 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:41.922688 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22405
W20260810 14:52:41.935642 22387 connection.cc:535] client connection to 127.0.0.1:34279 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34279): Connection reset by peer (error 104)
2026-08-10T14:52:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:41 dist-test-slave-4tdj krb5kdc[22553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:41 dist-test-slave-4tdj krb5kdc[22553](info): set up 2 sockets
Aug 10 14:52:41 dist-test-slave-4tdj krb5kdc[22553](info): commencing operation
krb5kdc: starting...
W20260810 14:52:43.090819 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.142s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:43 dist-test-slave-4tdj krb5kdc[22553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373563, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:43.220849 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33231
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35177
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33231
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:43.302356 22571 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:43.302554 22571 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:43.302577 22571 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:43.303707 22571 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:43.303747 22571 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:43.303761 22571 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:43.303776 22571 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:43.303788 22571 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:43.305294 22571 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35177
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33231
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33231
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22571
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:43.305506 22571 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:43.305716 22571 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:43.310370 22587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:43.310451 22571 server_base.cc:1034] running on GCE node
W20260810 14:52:43.310532 22582 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:43.310388 22585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:43.310877 22571 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:43.311161 22571 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:43.312304 22571 hybrid_clock.cc:648] HybridClock initialized: now 1786373563312290 us; error 27 us; skew 500 ppm
Aug 10 14:52:43 dist-test-slave-4tdj krb5kdc[22553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373563, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:43.314590 22571 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:43.314952 22571 webserver.cc:460] Webserver started at http://127.0.0.1:33499/ using document root <none> and password file <none>
I20260810 14:52:43.315146 22571 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:43.315186 22571 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:43.315275 22571 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:43.316212 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "e431f591f5b84ece8056d69018560531"
format_stamp: "Formatted at 2026-08-10 14:52:43 on dist-test-slave-4tdj"
server_key: "341ef047ec73edb369d785fbc3b04e81"
server_key_iv: "c1dbfeb2dc7476e89e88b95dbd639771"
server_key_version: "encryptionkey@0"
I20260810 14:52:43.316490 22571 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "e431f591f5b84ece8056d69018560531"
format_stamp: "Formatted at 2026-08-10 14:52:43 on dist-test-slave-4tdj"
server_key: "341ef047ec73edb369d785fbc3b04e81"
server_key_iv: "c1dbfeb2dc7476e89e88b95dbd639771"
server_key_version: "encryptionkey@0"
I20260810 14:52:43.317613 22571 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:43.318215 22600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:43.318380 22571 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:43.318459 22571 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "e431f591f5b84ece8056d69018560531"
format_stamp: "Formatted at 2026-08-10 14:52:43 on dist-test-slave-4tdj"
server_key: "341ef047ec73edb369d785fbc3b04e81"
server_key_iv: "c1dbfeb2dc7476e89e88b95dbd639771"
server_key_version: "encryptionkey@0"
I20260810 14:52:43.318523 22571 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:43.321641 22571 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:43.323329 22571 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:43.323444 22571 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:43.327256 22571 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33231
I20260810 14:52:43.327284 22672 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33231 every 8 connection(s)
I20260810 14:52:43.327566 22571 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:43.328459 22673 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:43.330647 22673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531: Bootstrap starting.
I20260810 14:52:43.331185 22673 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:43.331444 22673 log.cc:824] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:43.332055 22673 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531: No bootstrap required, opened a new log
I20260810 14:52:43.333586 22673 raft_consensus.cc:348] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } }
I20260810 14:52:43.333724 22673 raft_consensus.cc:374] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:43.333745 22673 raft_consensus.cc:729] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e431f591f5b84ece8056d69018560531, State: Initialized, Role: FOLLOWER
I20260810 14:52:43.333875 22673 consensus_queue.cc:260] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } }
I20260810 14:52:43.333935 22673 raft_consensus.cc:388] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:43.333954 22673 raft_consensus.cc:482] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:43.333987 22673 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:43.334535 22673 raft_consensus.cc:504] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } }
I20260810 14:52:43.334625 22673 leader_election.cc:302] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e431f591f5b84ece8056d69018560531; no voters:
I20260810 14:52:43.334793 22673 leader_election.cc:288] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:43.334842 22679 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:43.335000 22679 raft_consensus.cc:686] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [term 1 LEADER]: Becoming Leader. State: Replica: e431f591f5b84ece8056d69018560531, State: Running, Role: LEADER
I20260810 14:52:43.335028 22673 sys_catalog.cc:564] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:43.335093 22679 consensus_queue.cc:237] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } }
I20260810 14:52:43.335350 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22571
I20260810 14:52:43.335469 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:43.335672 19575 external_mini_cluster.cc:1428] Setting key 1e34da6dc659c79943fdafd1e99a64ab
I20260810 14:52:43.335719 22680 sys_catalog.cc:455] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e431f591f5b84ece8056d69018560531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } } }
I20260810 14:52:43.335736 22682 sys_catalog.cc:455] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e431f591f5b84ece8056d69018560531. Latest consensus state: current_term: 1 leader_uuid: "e431f591f5b84ece8056d69018560531" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e431f591f5b84ece8056d69018560531" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33231 } } }
I20260810 14:52:43.335807 22680 sys_catalog.cc:458] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:43.335825 22682 sys_catalog.cc:458] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:43.335983 22696 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:43.336493 22696 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:43.337980 22696 catalog_manager.cc:1347] Generated new cluster ID: 442b7e2fe02446419f72cfc73845198f
I20260810 14:52:43.338035 22696 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:43.339923 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:43.336315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:55837 (local address 127.0.0.1:33231)
0810 14:52:43.336644 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:43.336664 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:43.338507 (+ 1843us) server_negotiation.cc:407] Connection header received
0810 14:52:43.338649 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:43.338657 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:43.338689 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:43.338813 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:43.339511 (+ 698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:43.339515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:43.339515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:43.339519 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:43.339554 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:43.339565 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:43.339617 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:43.339698 (+ 81us) server_negotiation.cc:299] Negotiation successful
0810 14:52:43.339744 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":67,"threads_started":1}
I20260810 14:52:43.340736 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:43.342976 22706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:43.342019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:43989 (local address 127.0.0.1:33231)
0810 14:52:43.342053 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:43.342054 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:43.342176 (+ 122us) server_negotiation.cc:407] Connection header received
0810 14:52:43.342225 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:43.342226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:43.342230 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:43.342282 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:43.342787 (+ 505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:43.342788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:43.342788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:43.342792 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:43.342806 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:43.342809 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:43.342854 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:43.342904 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:52:43.342918 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:43.360829 22696 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:43.361024 22696 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:43.372730 22696 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e431f591f5b84ece8056d69018560531: Generated new TSK 0
I20260810 14:52:43.372908 22696 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:43.378317 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22571
2026-08-10T14:52:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1453 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:43 dist-test-slave-4tdj krb5kdc[22725](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:43 dist-test-slave-4tdj krb5kdc[22725](info): set up 2 sockets
Aug 10 14:52:43 dist-test-slave-4tdj krb5kdc[22725](info): commencing operation
krb5kdc: starting...
W20260810 14:52:44.541802 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.139s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:44.652751 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34537
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40809
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:44.731849 22740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:44.732043 22740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:44.732074 22740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:44.733196 22740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:44.733237 22740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:44.733255 22740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:44.733270 22740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:44.733296 22740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:44.734793 22740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40809
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34537
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:44.735028 22740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:44.735229 22740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:44.739914 22749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:44.739971 22740 server_base.cc:1034] running on GCE node
W20260810 14:52:44.739938 22748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:44.739943 22752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:44.740372 22740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:44.740649 22740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:44.741804 22740 hybrid_clock.cc:648] HybridClock initialized: now 1786373564741788 us; error 27 us; skew 500 ppm
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22725](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373564, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:44.744131 22740 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:44.744516 22740 webserver.cc:460] Webserver started at http://127.0.0.1:46087/ using document root <none> and password file <none>
I20260810 14:52:44.744730 22740 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:44.744776 22740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:44.744899 22740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:44.745877 22740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "9b49126b95194abca778471b49a5ae65"
format_stamp: "Formatted at 2026-08-10 14:52:44 on dist-test-slave-4tdj"
server_key: "e71946f4c1163bf24933f102e49a1c97"
server_key_iv: "d823c642e83eb5b2847f5809a6cf2a1f"
server_key_version: "encryptionkey@0"
I20260810 14:52:44.746204 22740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "9b49126b95194abca778471b49a5ae65"
format_stamp: "Formatted at 2026-08-10 14:52:44 on dist-test-slave-4tdj"
server_key: "e71946f4c1163bf24933f102e49a1c97"
server_key_iv: "d823c642e83eb5b2847f5809a6cf2a1f"
server_key_version: "encryptionkey@0"
I20260810 14:52:44.747473 22740 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:44.748121 22762 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:44.748301 22740 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:44.748396 22740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "9b49126b95194abca778471b49a5ae65"
format_stamp: "Formatted at 2026-08-10 14:52:44 on dist-test-slave-4tdj"
server_key: "e71946f4c1163bf24933f102e49a1c97"
server_key_iv: "d823c642e83eb5b2847f5809a6cf2a1f"
server_key_version: "encryptionkey@0"
I20260810 14:52:44.748461 22740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:44.774406 22740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:44.776410 22740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:44.776521 22740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:44.780182 22740 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34537
I20260810 14:52:44.780218 22838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34537 every 8 connection(s)
I20260810 14:52:44.780542 22740 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:44.781380 22839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:44.783658 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65: Bootstrap starting.
I20260810 14:52:44.784215 22839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:44.784467 22839 log.cc:824] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:44.785144 22839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65: No bootstrap required, opened a new log
I20260810 14:52:44.786823 22839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } }
I20260810 14:52:44.786959 22839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:44.786994 22839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b49126b95194abca778471b49a5ae65, State: Initialized, Role: FOLLOWER
I20260810 14:52:44.787134 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22740
I20260810 14:52:44.787137 22839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } }
I20260810 14:52:44.787215 22839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:44.787240 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:44.787252 22839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:44.787300 22839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:44.787431 19575 external_mini_cluster.cc:1428] Setting key cd336cdeeb3c11d86319db28ceb036bd
I20260810 14:52:44.787930 22839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } }
I20260810 14:52:44.788081 22839 leader_election.cc:302] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b49126b95194abca778471b49a5ae65; no voters:
I20260810 14:52:44.788254 22839 leader_election.cc:288] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:44.788281 22851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:44.788386 22851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [term 1 LEADER]: Becoming Leader. State: Replica: 9b49126b95194abca778471b49a5ae65, State: Running, Role: LEADER
I20260810 14:52:44.788507 22839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:44.788527 22851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } }
I20260810 14:52:44.789057 22853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b49126b95194abca778471b49a5ae65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } } }
I20260810 14:52:44.789148 22853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:44.789426 22854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b49126b95194abca778471b49a5ae65. Latest consensus state: current_term: 1 leader_uuid: "9b49126b95194abca778471b49a5ae65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b49126b95194abca778471b49a5ae65" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34537 } } }
I20260810 14:52:44.789573 22854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:44.789696 22870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:44.790205 22870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:44.791625 22870 catalog_manager.cc:1347] Generated new cluster ID: 40c5fda1bc804ce1a6cfadbb0cf5df73
I20260810 14:52:44.791679 22870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22725](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373564, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260810 14:52:44.797217 22850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:44.787869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:50739 (local address 127.0.0.1:34537)
0810 14:52:44.788029 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:44.788038 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:44.788070 (+ 32us) server_negotiation.cc:407] Connection header received
0810 14:52:44.788171 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:44.788178 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:44.788234 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:44.789069 (+ 835us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:44.789163 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:44.790545 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:44.791596 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:44.792054 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:44.792151 (+ 97us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:44.794256 (+ 2105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:44.794260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:44.794260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:44.794272 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:44.795776 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:44.796123 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:44.796127 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:44.796127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:44.796230 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:44.796433 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:44.796434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:44.796434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:44.796656 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:44.796835 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:44.796914 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 14:52:44.797009 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260810 14:52:44.798058 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:44.799618 22870 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:44.800283 22870 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:44.804018 22870 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b49126b95194abca778471b49a5ae65: Generated new TSK 0
I20260810 14:52:44.804234 22870 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:44.805125 22850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:44.799331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:58607 (local address 127.0.0.1:34537)
0810 14:52:44.799389 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:44.799391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:44.799702 (+ 311us) server_negotiation.cc:407] Connection header received
0810 14:52:44.799773 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:44.799774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:44.799783 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:44.799827 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:44.800271 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:44.800768 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:44.801430 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:44.801642 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:44.801699 (+ 57us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:44.802765 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:44.802766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:44.802767 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:44.802773 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:44.804109 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:44.804514 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:44.804515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:44.804515 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:44.804562 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:44.804757 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:44.804758 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:44.804758 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:44.804838 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:44.804902 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:44.805030 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:52:44.805075 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260810 14:52:44.807176 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22740
W20260810 14:52:44.825567 22721 connection.cc:535] client connection to 127.0.0.1:34537 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34537): Connection reset by peer (error 104)
2026-08-10T14:52:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22899](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22899](info): set up 2 sockets
Aug 10 14:52:44 dist-test-slave-4tdj krb5kdc[22899](info): commencing operation
krb5kdc: starting...
W20260810 14:52:45.975692 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:46 dist-test-slave-4tdj krb5kdc[22899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373566, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:46.097349 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40487
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37983
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40487
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:46.178162 22919 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:46.178391 22919 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:46.178413 22919 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:46.179502 22919 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:46.179536 22919 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:46.179548 22919 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:46.179560 22919 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:46.179577 22919 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:46.180991 22919 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37983
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40487
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40487
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22919
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:46.181198 22919 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:46.181368 22919 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:46.186141 22930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:46.186187 22928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:46.186367 22919 server_base.cc:1034] running on GCE node
W20260810 14:52:46.186265 22927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:46.186669 22919 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:46.186942 22919 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:46.188079 22919 hybrid_clock.cc:648] HybridClock initialized: now 1786373566188066 us; error 37 us; skew 500 ppm
Aug 10 14:52:46 dist-test-slave-4tdj krb5kdc[22899](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373566, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:46.190354 22919 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:46.190757 22919 webserver.cc:460] Webserver started at http://127.0.0.1:37981/ using document root <none> and password file <none>
I20260810 14:52:46.190973 22919 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:46.191021 22919 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:46.191143 22919 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:46.192189 22919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "98b3cb2e8fe241d59fd2373774ca9559"
format_stamp: "Formatted at 2026-08-10 14:52:46 on dist-test-slave-4tdj"
server_key: "8dbb7ae4daa2cf585fa8fd57b692babf"
server_key_iv: "40f86f1b4981d0248db7cea63021f377"
server_key_version: "encryptionkey@0"
I20260810 14:52:46.192505 22919 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "98b3cb2e8fe241d59fd2373774ca9559"
format_stamp: "Formatted at 2026-08-10 14:52:46 on dist-test-slave-4tdj"
server_key: "8dbb7ae4daa2cf585fa8fd57b692babf"
server_key_iv: "40f86f1b4981d0248db7cea63021f377"
server_key_version: "encryptionkey@0"
I20260810 14:52:46.193723 22919 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:46.194360 22940 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:46.194492 22919 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:46.194578 22919 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "98b3cb2e8fe241d59fd2373774ca9559"
format_stamp: "Formatted at 2026-08-10 14:52:46 on dist-test-slave-4tdj"
server_key: "8dbb7ae4daa2cf585fa8fd57b692babf"
server_key_iv: "40f86f1b4981d0248db7cea63021f377"
server_key_version: "encryptionkey@0"
I20260810 14:52:46.194636 22919 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:46.206740 22919 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:46.208415 22919 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:46.208546 22919 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:46.212370 22919 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40487
I20260810 14:52:46.212409 23026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40487 every 8 connection(s)
I20260810 14:52:46.212728 22919 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:46.213573 23027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:46.215925 23027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559: Bootstrap starting.
I20260810 14:52:46.216496 23027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:46.216758 23027 log.cc:824] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:46.217398 23027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559: No bootstrap required, opened a new log
I20260810 14:52:46.219034 23027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260810 14:52:46.219172 23027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:46.219193 23027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98b3cb2e8fe241d59fd2373774ca9559, State: Initialized, Role: FOLLOWER
I20260810 14:52:46.219326 23027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260810 14:52:46.219384 23027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:46.219408 23027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:46.219455 23027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:46.219949 23027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260810 14:52:46.220054 23027 leader_election.cc:302] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 98b3cb2e8fe241d59fd2373774ca9559; no voters:
I20260810 14:52:46.220201 23027 leader_election.cc:288] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:46.220234 23030 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:46.220362 23030 raft_consensus.cc:686] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [term 1 LEADER]: Becoming Leader. State: Replica: 98b3cb2e8fe241d59fd2373774ca9559, State: Running, Role: LEADER
I20260810 14:52:46.220448 23027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:46.220481 23030 consensus_queue.cc:237] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } }
I20260810 14:52:46.220856 23032 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98b3cb2e8fe241d59fd2373774ca9559. Latest consensus state: current_term: 1 leader_uuid: "98b3cb2e8fe241d59fd2373774ca9559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } } }
I20260810 14:52:46.220974 23031 sys_catalog.cc:455] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "98b3cb2e8fe241d59fd2373774ca9559" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "98b3cb2e8fe241d59fd2373774ca9559" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40487 } } }
I20260810 14:52:46.220991 23032 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:46.221063 23031 sys_catalog.cc:458] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:46.221318 23041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:46.221860 23041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:46.222121 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 22919
I20260810 14:52:46.222242 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:46.222452 19575 external_mini_cluster.cc:1428] Setting key a79150cef088e5727582d77d9cb89095
I20260810 14:52:46.223414 23041 catalog_manager.cc:1347] Generated new cluster ID: 30577cde337647f49aa39b1cf6a76faf
I20260810 14:52:46.223459 23041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:46.228139 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:46.222872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:36021 (local address 127.0.0.1:40487)
0810 14:52:46.223028 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:46.223037 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:46.223121 (+ 84us) server_negotiation.cc:407] Connection header received
0810 14:52:46.223274 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:46.223281 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:46.223339 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:46.223481 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:46.223703 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:46.225019 (+ 1316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:46.226020 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:46.226670 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:46.226783 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:46.227452 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:46.227456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:46.227456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:46.227683 (+ 227us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:46.227728 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:46.227743 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:46.227830 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:46.227895 (+ 65us) server_negotiation.cc:299] Negotiation successful
0810 14:52:46.227925 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":79,"threads_started":1}
I20260810 14:52:46.229122 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:46.233801 23055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:46.230448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:47563 (local address 127.0.0.1:40487)
0810 14:52:46.230485 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:46.230487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:46.230556 (+ 69us) server_negotiation.cc:407] Connection header received
0810 14:52:46.230622 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:46.230623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:46.230633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:46.230688 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:46.230810 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:46.231506 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:46.232565 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:46.232878 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:46.232934 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:46.233564 (+ 630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:46.233566 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:46.233566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:46.233570 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:46.233585 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:46.233589 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:46.233638 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:46.233721 (+ 83us) server_negotiation.cc:299] Negotiation successful
0810 14:52:46.233732 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:52:46.240221 23041 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:46.240708 23041 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:46.246536 23041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 98b3cb2e8fe241d59fd2373774ca9559: Generated new TSK 0
I20260810 14:52:46.246708 23041 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:46.252799 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 22919
W20260810 14:52:46.265782 22896 connection.cc:535] client connection to 127.0.0.1:40487 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40487): Connection reset by peer (error 104)
2026-08-10T14:52:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1441 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:46 dist-test-slave-4tdj krb5kdc[23066](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:46 dist-test-slave-4tdj krb5kdc[23066](info): set up 2 sockets
Aug 10 14:52:46 dist-test-slave-4tdj krb5kdc[23066](info): commencing operation
krb5kdc: starting...
W20260810 14:52:47.420748 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.141s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:47 dist-test-slave-4tdj krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260810 14:52:47.532963 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38665
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:47.612022 23088 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:47.612211 23088 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:47.612233 23088 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:47.613341 23088 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:47.613380 23088 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:47.613394 23088 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:47.613406 23088 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:47.613430 23088 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:47.614920 23088 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38665
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23088
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:47.615150 23088 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:47.615346 23088 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:47.620030 23099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:47.620042 23100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:47.620045 23103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:47.620129 23088 server_base.cc:1034] running on GCE node
I20260810 14:52:47.620471 23088 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:47.620718 23088 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:47.621857 23088 hybrid_clock.cc:648] HybridClock initialized: now 1786373567621833 us; error 41 us; skew 500 ppm
Aug 10 14:52:47 dist-test-slave-4tdj krb5kdc[23066](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373567, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:47.624233 23088 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260810 14:52:47.624620 23088 webserver.cc:460] Webserver started at http://127.0.0.1:35367/ using document root <none> and password file <none>
I20260810 14:52:47.624825 23088 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:47.624872 23088 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:47.624995 23088 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:47.625963 23088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "4b87f8a990ed490a83d86f5d407b3385"
format_stamp: "Formatted at 2026-08-10 14:52:47 on dist-test-slave-4tdj"
server_key: "e9f831ff5bde7c0df76089e7d240923a"
server_key_iv: "db6349c3d9cbfd45d90998a08df5e51e"
server_key_version: "encryptionkey@0"
I20260810 14:52:47.626278 23088 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "4b87f8a990ed490a83d86f5d407b3385"
format_stamp: "Formatted at 2026-08-10 14:52:47 on dist-test-slave-4tdj"
server_key: "e9f831ff5bde7c0df76089e7d240923a"
server_key_iv: "db6349c3d9cbfd45d90998a08df5e51e"
server_key_version: "encryptionkey@0"
I20260810 14:52:47.627552 23088 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:47.628186 23111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:47.628336 23088 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:47.628420 23088 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "4b87f8a990ed490a83d86f5d407b3385"
format_stamp: "Formatted at 2026-08-10 14:52:47 on dist-test-slave-4tdj"
server_key: "e9f831ff5bde7c0df76089e7d240923a"
server_key_iv: "db6349c3d9cbfd45d90998a08df5e51e"
server_key_version: "encryptionkey@0"
I20260810 14:52:47.628476 23088 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:47.631636 23088 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:47.633595 23088 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:47.633718 23088 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:47.637450 23088 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38665
I20260810 14:52:47.637480 23195 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38665 every 8 connection(s)
I20260810 14:52:47.637766 23088 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:47.638803 23197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:47.640949 23197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385: Bootstrap starting.
I20260810 14:52:47.641474 23197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:47.641716 23197 log.cc:824] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:47.642422 23197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385: No bootstrap required, opened a new log
I20260810 14:52:47.643950 23197 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } }
I20260810 14:52:47.644083 23197 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:47.644104 23197 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b87f8a990ed490a83d86f5d407b3385, State: Initialized, Role: FOLLOWER
I20260810 14:52:47.644214 23197 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } }
I20260810 14:52:47.644265 23197 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:47.644284 23197 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:47.644313 23197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:47.644810 23197 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } }
I20260810 14:52:47.644894 23197 leader_election.cc:302] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b87f8a990ed490a83d86f5d407b3385; no voters:
I20260810 14:52:47.645020 23197 leader_election.cc:288] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:47.645068 23200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:47.645251 23197 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:47.645256 23200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [term 1 LEADER]: Becoming Leader. State: Replica: 4b87f8a990ed490a83d86f5d407b3385, State: Running, Role: LEADER
I20260810 14:52:47.645372 23200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } }
I20260810 14:52:47.645716 23202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b87f8a990ed490a83d86f5d407b3385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } } }
I20260810 14:52:47.645723 23203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b87f8a990ed490a83d86f5d407b3385. Latest consensus state: current_term: 1 leader_uuid: "4b87f8a990ed490a83d86f5d407b3385" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b87f8a990ed490a83d86f5d407b3385" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38665 } } }
I20260810 14:52:47.645816 23202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:47.645819 23203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:47.646054 23207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:47.646699 23207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:47.647341 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23088
I20260810 14:52:47.647464 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:47.647662 19575 external_mini_cluster.cc:1428] Setting key c3d21bd571f45627dd4aa3cdf86ab810
I20260810 14:52:47.648918 23207 catalog_manager.cc:1347] Generated new cluster ID: f775640fb89e4b94bf6b18ff9eed877c
I20260810 14:52:47.648964 23207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:47.649775 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:47.648057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:36407 (local address 127.0.0.1:38665)
0810 14:52:47.648361 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:47.648370 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:47.648401 (+ 31us) server_negotiation.cc:407] Connection header received
0810 14:52:47.648520 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:47.648528 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:47.648558 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:47.648687 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:47.649345 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:47.649349 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:47.649349 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:47.649353 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:47.649390 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:47.649401 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:47.649452 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:47.649516 (+ 64us) server_negotiation.cc:299] Negotiation successful
0810 14:52:47.649641 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":259,"thread_start_us":83,"threads_started":1}
I20260810 14:52:47.650696 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:47.652951 23233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:47.652004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.56:58303 (local address 127.0.0.1:38665)
0810 14:52:47.652036 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:47.652038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:47.652159 (+ 121us) server_negotiation.cc:407] Connection header received
0810 14:52:47.652213 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:47.652213 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:47.652218 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:47.652262 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:47.652763 (+ 501us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:47.652764 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:47.652765 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:47.652769 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:47.652783 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:47.652787 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:47.652832 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:47.652882 (+ 50us) server_negotiation.cc:299] Negotiation successful
0810 14:52:47.652895 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:47.678678 23207 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:47.678853 23207 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:47.684240 23207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b87f8a990ed490a83d86f5d407b3385: Generated new TSK 0
I20260810 14:52:47.684406 23207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:47.687947 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23088
2026-08-10T14:52:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1430 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:47 dist-test-slave-4tdj krb5kdc[23243](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:47 dist-test-slave-4tdj krb5kdc[23243](info): set up 2 sockets
Aug 10 14:52:47 dist-test-slave-4tdj krb5kdc[23243](info): commencing operation
krb5kdc: starting...
W20260810 14:52:48.837868 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.127s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:48 dist-test-slave-4tdj krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:48.950920 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39187
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:36793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:39187
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:49.032035 23263 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:49.032219 23263 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:49.032240 23263 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:49.033313 23263 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:49.033349 23263 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:49.033362 23263 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:49.033388 23263 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:49.033399 23263 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:49.034868 23263 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:36793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:39187
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:39187
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23263
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:49.035058 23263 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:49.035229 23263 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:49.039927 23279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:49.039940 23271 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:49.039963 23272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:49.040232 23263 server_base.cc:1034] running on GCE node
I20260810 14:52:49.040535 23263 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:49.040778 23263 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:49.041911 23263 hybrid_clock.cc:648] HybridClock initialized: now 1786373569041899 us; error 29 us; skew 500 ppm
Aug 10 14:52:49 dist-test-slave-4tdj krb5kdc[23243](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373569, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:49.050596 23263 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:49.051014 23263 webserver.cc:460] Webserver started at http://127.19.29.254:41173/ using document root <none> and password file <none>
I20260810 14:52:49.051229 23263 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:49.051277 23263 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:49.051399 23263 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:49.052395 23263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "3fd87ca821c24e57afe10b2057dd995d"
format_stamp: "Formatted at 2026-08-10 14:52:49 on dist-test-slave-4tdj"
server_key: "7b79e2457582592da0fc0fd8659f0d47"
server_key_iv: "80cb7c183c4791940bfd216245b8f4e1"
server_key_version: "encryptionkey@0"
I20260810 14:52:49.052729 23263 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "3fd87ca821c24e57afe10b2057dd995d"
format_stamp: "Formatted at 2026-08-10 14:52:49 on dist-test-slave-4tdj"
server_key: "7b79e2457582592da0fc0fd8659f0d47"
server_key_iv: "80cb7c183c4791940bfd216245b8f4e1"
server_key_version: "encryptionkey@0"
I20260810 14:52:49.053942 23263 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:49.054605 23286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:49.054737 23263 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:49.054826 23263 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "3fd87ca821c24e57afe10b2057dd995d"
format_stamp: "Formatted at 2026-08-10 14:52:49 on dist-test-slave-4tdj"
server_key: "7b79e2457582592da0fc0fd8659f0d47"
server_key_iv: "80cb7c183c4791940bfd216245b8f4e1"
server_key_version: "encryptionkey@0"
I20260810 14:52:49.054881 23263 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:49.064164 23263 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:49.065757 23263 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:49.065882 23263 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:49.069588 23263 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:39187
I20260810 14:52:49.069638 23373 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:39187 every 8 connection(s)
I20260810 14:52:49.069927 23263 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:49.070799 23374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:49.072979 23374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: Bootstrap starting.
I20260810 14:52:49.073531 23374 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:49.073800 23374 log.cc:824] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:49.074474 23374 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: No bootstrap required, opened a new log
I20260810 14:52:49.075491 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23263
I20260810 14:52:49.075618 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:49.075798 19575 external_mini_cluster.cc:1428] Setting key 5153c86f5fa873078ad625f24fb5276d
I20260810 14:52:49.076376 23374 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } }
I20260810 14:52:49.076532 23374 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:49.076557 23374 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fd87ca821c24e57afe10b2057dd995d, State: Initialized, Role: FOLLOWER
I20260810 14:52:49.076676 23374 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } }
I20260810 14:52:49.076738 23374 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:49.076768 23374 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:49.076854 23374 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:49.077831 23374 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } }
I20260810 14:52:49.077930 23374 leader_election.cc:302] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3fd87ca821c24e57afe10b2057dd995d; no voters:
I20260810 14:52:49.078080 23374 leader_election.cc:288] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:49.078114 23383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:49.078262 23383 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [term 1 LEADER]: Becoming Leader. State: Replica: 3fd87ca821c24e57afe10b2057dd995d, State: Running, Role: LEADER
I20260810 14:52:49.078352 23374 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:49.078423 23383 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } }
I20260810 14:52:49.078759 23383 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3fd87ca821c24e57afe10b2057dd995d. Latest consensus state: current_term: 1 leader_uuid: "3fd87ca821c24e57afe10b2057dd995d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } } }
I20260810 14:52:49.078832 23383 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:49.078811 23390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3fd87ca821c24e57afe10b2057dd995d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3fd87ca821c24e57afe10b2057dd995d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 39187 } } }
I20260810 14:52:49.078894 23390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d [sys.catalog]: This master's current role is: LEADER
W20260810 14:52:49.080027 23411 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:52:49.080082 23411 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:52:49.080132 23400 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:49.080271 23400 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:49.081629 23400 catalog_manager.cc:1347] Generated new cluster ID: 65053f1106a34242bbda0d7143992ac9
I20260810 14:52:49.081679 23400 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 10 14:52:49 dist-test-slave-4tdj krb5kdc[23243](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373568, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:49.085675 23382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:49.076283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33583 (local address 127.19.29.254:39187)
0810 14:52:49.076440 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:49.076448 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:49.076472 (+ 24us) server_negotiation.cc:407] Connection header received
0810 14:52:49.076574 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:49.076582 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:49.076635 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:49.076784 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:49.077522 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:49.078694 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:49.079821 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:49.080279 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:49.080381 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:49.082773 (+ 2392us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:49.082777 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:49.082778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:49.082790 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:49.084233 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:49.084572 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:49.084576 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:49.084576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:49.084683 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:49.084880 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:49.084881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:49.084881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:49.085093 (+ 212us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:49.085267 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:49.085383 (+ 116us) server_negotiation.cc:299] Negotiation successful
0810 14:52:49.085481 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":74,"threads_started":1}
I20260810 14:52:49.086874 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:49.093161 23400 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:49.093817 23400 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:49.095736 23382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:49.088104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59245 (local address 127.19.29.254:39187)
0810 14:52:49.088138 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:49.088140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:49.090425 (+ 2285us) server_negotiation.cc:407] Connection header received
0810 14:52:49.090480 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:49.090481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:49.090491 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:49.090544 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:49.090982 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:49.091440 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:49.092086 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:49.092285 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:49.092339 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:49.093488 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:49.093490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:49.093490 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:49.093496 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:49.094727 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:49.095042 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:49.095043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:49.095043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:49.095089 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:49.095276 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:49.095277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:49.095277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:49.095368 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:49.095449 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:49.095586 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 14:52:49.095644 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:49.104519 23400 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3fd87ca821c24e57afe10b2057dd995d: Generated new TSK 0
I20260810 14:52:49.104686 23400 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:49.106269 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23263
W20260810 14:52:49.128450 23241 connection.cc:535] client connection to 127.19.29.254:39187 recv error: Network error: failed to read from TLS socket (remote: 127.19.29.254:39187): Connection reset by peer (error 104)
2026-08-10T14:52:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:49 dist-test-slave-4tdj krb5kdc[23425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:49 dist-test-slave-4tdj krb5kdc[23425](info): set up 2 sockets
Aug 10 14:52:49 dist-test-slave-4tdj krb5kdc[23425](info): commencing operation
krb5kdc: starting...
W20260810 14:52:50.277916 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.136s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:50 dist-test-slave-4tdj krb5kdc[23425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373570, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:50.396278 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44093
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:42853
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:44093
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:50.476025 23445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:50.476215 23445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:50.476236 23445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:50.477299 23445 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:50.477332 23445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:50.477344 23445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:50.477355 23445 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:50.477365 23445 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:50.478770 23445 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:42853
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:44093
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:44093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:50.478950 23445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:50.479104 23445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:50.483680 23454 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:50.483651 23453 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:50.483672 23461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:50.483889 23445 server_base.cc:1034] running on GCE node
I20260810 14:52:50.484130 23445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:50.484416 23445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:50.485548 23445 hybrid_clock.cc:648] HybridClock initialized: now 1786373570485531 us; error 36 us; skew 500 ppm
Aug 10 14:52:50 dist-test-slave-4tdj krb5kdc[23425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373570, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:50.487905 23445 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:50.488307 23445 webserver.cc:460] Webserver started at http://127.19.29.254:33311/ using document root <none> and password file <none>
I20260810 14:52:50.488497 23445 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:50.488541 23445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:50.488664 23445 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:50.489660 23445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "cc1a97203dca4a4b91796bdc405c930d"
format_stamp: "Formatted at 2026-08-10 14:52:50 on dist-test-slave-4tdj"
server_key: "2b4fa56fc48c2ceec1efe55109cfb227"
server_key_iv: "76eee6a95dc921dd114f55c7b20243de"
server_key_version: "encryptionkey@0"
I20260810 14:52:50.489979 23445 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "cc1a97203dca4a4b91796bdc405c930d"
format_stamp: "Formatted at 2026-08-10 14:52:50 on dist-test-slave-4tdj"
server_key: "2b4fa56fc48c2ceec1efe55109cfb227"
server_key_iv: "76eee6a95dc921dd114f55c7b20243de"
server_key_version: "encryptionkey@0"
I20260810 14:52:50.491237 23445 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:50.491923 23477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:50.492066 23445 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:50.492153 23445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "cc1a97203dca4a4b91796bdc405c930d"
format_stamp: "Formatted at 2026-08-10 14:52:50 on dist-test-slave-4tdj"
server_key: "2b4fa56fc48c2ceec1efe55109cfb227"
server_key_iv: "76eee6a95dc921dd114f55c7b20243de"
server_key_version: "encryptionkey@0"
I20260810 14:52:50.492215 23445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:50.508777 23445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:50.510512 23445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:50.510643 23445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:50.514338 23445 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:44093
I20260810 14:52:50.514362 23561 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:44093 every 8 connection(s)
I20260810 14:52:50.514688 23445 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:50.515486 23565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:50.517684 23565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d: Bootstrap starting.
I20260810 14:52:50.518343 23565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:50.518615 23565 log.cc:824] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:50.519240 23565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d: No bootstrap required, opened a new log
I20260810 14:52:50.520761 23565 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } }
I20260810 14:52:50.520936 23565 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:50.520936 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23445
I20260810 14:52:50.520979 23565 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc1a97203dca4a4b91796bdc405c930d, State: Initialized, Role: FOLLOWER
I20260810 14:52:50.521042 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:50.521143 23565 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } }
I20260810 14:52:50.521229 23565 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:50.521258 19575 external_mini_cluster.cc:1428] Setting key 01658f45eea606c4ebc5cf7b23e5980d
I20260810 14:52:50.521265 23565 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:50.521309 23565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:50.522243 23565 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } }
I20260810 14:52:50.522377 23565 leader_election.cc:302] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc1a97203dca4a4b91796bdc405c930d; no voters:
I20260810 14:52:50.522529 23565 leader_election.cc:288] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:50.522573 23572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:50.522681 23572 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [term 1 LEADER]: Becoming Leader. State: Replica: cc1a97203dca4a4b91796bdc405c930d, State: Running, Role: LEADER
I20260810 14:52:50.522784 23565 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:50.522827 23572 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } }
I20260810 14:52:50.523176 23572 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc1a97203dca4a4b91796bdc405c930d. Latest consensus state: current_term: 1 leader_uuid: "cc1a97203dca4a4b91796bdc405c930d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } } }
I20260810 14:52:50.523305 23572 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:50.523265 23575 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc1a97203dca4a4b91796bdc405c930d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc1a97203dca4a4b91796bdc405c930d" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 44093 } } }
I20260810 14:52:50.523428 23575 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:50.523595 23585 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:50.524144 23585 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:50.525938 23585 catalog_manager.cc:1347] Generated new cluster ID: d0d454a1bbd14117836da719e2e8c5c5
I20260810 14:52:50.525997 23585 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:50.527297 23571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:50.521750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33019 (local address 127.19.29.254:44093)
0810 14:52:50.521927 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:50.521936 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:50.521961 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:52:50.522049 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:50.522054 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:50.522094 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:50.522205 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:50.522468 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:50.523731 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:50.524791 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:50.525351 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:50.525457 (+ 106us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:50.526702 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:50.526705 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:50.526706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:50.526866 (+ 160us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:50.526894 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:50.526905 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:50.526974 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:50.527064 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 14:52:50.527093 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
I20260810 14:52:50.528103 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:50.532027 23571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:50.529348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56901 (local address 127.19.29.254:44093)
0810 14:52:50.529381 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:50.529382 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:50.529493 (+ 111us) server_negotiation.cc:407] Connection header received
0810 14:52:50.529547 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:50.529547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:50.529558 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:50.529603 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:50.529705 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:50.530177 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:50.530890 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:50.531135 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:50.531190 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:50.531807 (+ 617us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:50.531808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:50.531808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:50.531812 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:50.531826 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:50.531830 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:50.531874 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:50.531940 (+ 66us) server_negotiation.cc:299] Negotiation successful
0810 14:52:50.531952 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:52:50.545544 23585 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:50.546057 23585 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:50.554469 23585 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc1a97203dca4a4b91796bdc405c930d: Generated new TSK 0
I20260810 14:52:50.554679 23585 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:50.563432 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23445
W20260810 14:52:50.587949 23421 connection.cc:535] client connection to 127.19.29.254:44093 recv error: Network error: failed to read from TLS socket (remote: 127.19.29.254:44093): Connection reset by peer (error 104)
2026-08-10T14:52:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1459 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:50 dist-test-slave-4tdj krb5kdc[23620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:50 dist-test-slave-4tdj krb5kdc[23620](info): set up 2 sockets
Aug 10 14:52:50 dist-test-slave-4tdj krb5kdc[23620](info): commencing operation
krb5kdc: starting...
W20260810 14:52:51.730369 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.129s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:51 dist-test-slave-4tdj krb5kdc[23620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373571, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:51.841188 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34275
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45963
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:34275
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:51.920603 23636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:51.920799 23636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:51.920830 23636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:51.921939 23636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:51.921979 23636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:51.921998 23636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:51.922014 23636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:51.922029 23636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:51.923494 23636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45963
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:34275
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:34275
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23636
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:51.923738 23636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:51.923934 23636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:52:51.928610 23636 server_base.cc:1034] running on GCE node
W20260810 14:52:51.928561 23645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:51.928566 23643 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:51.928746 23647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:51.929015 23636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:51.929275 23636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:51.930403 23636 hybrid_clock.cc:648] HybridClock initialized: now 1786373571930388 us; error 39 us; skew 500 ppm
Aug 10 14:52:51 dist-test-slave-4tdj krb5kdc[23620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373571, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:51.932758 23636 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:51.933180 23636 webserver.cc:460] Webserver started at http://127.19.29.254:35031/ using document root <none> and password file <none>
I20260810 14:52:51.933387 23636 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:51.933434 23636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:51.933555 23636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:51.934592 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "c51455ab0dd54b689b64cbbff7176ef8"
format_stamp: "Formatted at 2026-08-10 14:52:51 on dist-test-slave-4tdj"
server_key: "c276e9e2211eefe90d68dabc444ff262"
server_key_iv: "7046ec34ce80f8d81a329d09c2fae516"
server_key_version: "encryptionkey@0"
I20260810 14:52:51.934914 23636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "c51455ab0dd54b689b64cbbff7176ef8"
format_stamp: "Formatted at 2026-08-10 14:52:51 on dist-test-slave-4tdj"
server_key: "c276e9e2211eefe90d68dabc444ff262"
server_key_iv: "7046ec34ce80f8d81a329d09c2fae516"
server_key_version: "encryptionkey@0"
I20260810 14:52:51.936101 23636 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:51.936779 23657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:51.936924 23636 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:51.937008 23636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "c51455ab0dd54b689b64cbbff7176ef8"
format_stamp: "Formatted at 2026-08-10 14:52:51 on dist-test-slave-4tdj"
server_key: "c276e9e2211eefe90d68dabc444ff262"
server_key_iv: "7046ec34ce80f8d81a329d09c2fae516"
server_key_version: "encryptionkey@0"
I20260810 14:52:51.937067 23636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:51.940227 23636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:51.941864 23636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:51.941983 23636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:51.945791 23636 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:34275
I20260810 14:52:51.945824 23743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:34275 every 8 connection(s)
I20260810 14:52:51.946099 23636 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:51.947118 23744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:51.949252 23744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8: Bootstrap starting.
I20260810 14:52:51.949796 23744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:51.950047 23744 log.cc:824] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:51.950708 23744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8: No bootstrap required, opened a new log
I20260810 14:52:51.952224 23744 raft_consensus.cc:348] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } }
I20260810 14:52:51.952351 23744 raft_consensus.cc:374] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:51.952384 23744 raft_consensus.cc:729] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c51455ab0dd54b689b64cbbff7176ef8, State: Initialized, Role: FOLLOWER
I20260810 14:52:51.952519 23744 consensus_queue.cc:260] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } }
I20260810 14:52:51.952595 23744 raft_consensus.cc:388] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:51.952630 23744 raft_consensus.cc:482] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:51.952675 23744 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:51.953449 23744 raft_consensus.cc:504] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } }
I20260810 14:52:51.953542 23744 leader_election.cc:302] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c51455ab0dd54b689b64cbbff7176ef8; no voters:
I20260810 14:52:51.953692 23744 leader_election.cc:288] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:51.953722 23748 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:51.953845 23748 raft_consensus.cc:686] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [term 1 LEADER]: Becoming Leader. State: Replica: c51455ab0dd54b689b64cbbff7176ef8, State: Running, Role: LEADER
I20260810 14:52:51.953948 23744 sys_catalog.cc:564] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:51.953979 23748 consensus_queue.cc:237] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } }
I20260810 14:52:51.954381 23750 sys_catalog.cc:455] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c51455ab0dd54b689b64cbbff7176ef8. Latest consensus state: current_term: 1 leader_uuid: "c51455ab0dd54b689b64cbbff7176ef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } } }
I20260810 14:52:51.954376 23749 sys_catalog.cc:455] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c51455ab0dd54b689b64cbbff7176ef8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c51455ab0dd54b689b64cbbff7176ef8" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 34275 } } }
I20260810 14:52:51.954530 23749 sys_catalog.cc:458] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:51.954524 23750 sys_catalog.cc:458] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:51.954975 23761 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:51.955473 23761 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:51.955475 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23636
I20260810 14:52:51.955590 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:51.955790 19575 external_mini_cluster.cc:1428] Setting key e85cc3c80b34c5c32742f0966e65d848
I20260810 14:52:51.956974 23761 catalog_manager.cc:1347] Generated new cluster ID: 8482159d014a475bb5d03d6ee90c3fc7
I20260810 14:52:51.957033 23761 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:51.958159 23781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:51.956208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43623 (local address 127.19.29.254:34275)
0810 14:52:51.956375 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:51.956385 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:51.956611 (+ 226us) server_negotiation.cc:407] Connection header received
0810 14:52:51.956748 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:51.956755 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:51.956785 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:51.957181 (+ 396us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:51.957661 (+ 480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:51.957665 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:51.957665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:51.957669 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:51.957704 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:51.957718 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:51.957919 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:51.957950 (+ 31us) server_negotiation.cc:299] Negotiation successful
0810 14:52:51.957992 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":67,"threads_started":1}
I20260810 14:52:51.958985 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:51.967417 23781 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:51.960482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35467 (local address 127.19.29.254:34275)
0810 14:52:51.960513 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:51.960514 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:51.966543 (+ 6029us) server_negotiation.cc:407] Connection header received
0810 14:52:51.966651 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:51.966652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:51.966658 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:51.966713 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:51.967236 (+ 523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:51.967237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:51.967237 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:51.967241 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:51.967255 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:51.967260 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:51.967306 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:51.967347 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 14:52:51.967359 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:51.974747 23761 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:51.974891 23761 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:51.979740 23761 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c51455ab0dd54b689b64cbbff7176ef8: Generated new TSK 0
I20260810 14:52:51.979895 23761 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:51.985229 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23636
2026-08-10T14:52:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1420 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:52 dist-test-slave-4tdj krb5kdc[23794](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:52 dist-test-slave-4tdj krb5kdc[23794](info): set up 2 sockets
Aug 10 14:52:52 dist-test-slave-4tdj krb5kdc[23794](info): commencing operation
krb5kdc: starting...
W20260810 14:52:53.158713 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.137s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:53.284881 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36441
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36441
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:53.364851 23814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:53.365032 23814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:53.365062 23814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:53.366165 23814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:53.366204 23814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:53.366223 23814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:53.366240 23814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:53.366254 23814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:53.367703 23814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36441
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36441
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:53.367931 23814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:53.368121 23814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:53.372818 23821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:53.373035 23814 server_base.cc:1034] running on GCE node
W20260810 14:52:53.372822 23826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:53.372829 23820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:53.373358 23814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:53.373633 23814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:53.374771 23814 hybrid_clock.cc:648] HybridClock initialized: now 1786373573374754 us; error 30 us; skew 500 ppm
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23794](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373573, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:53.376977 23814 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:53.377359 23814 webserver.cc:460] Webserver started at http://127.19.29.254:43129/ using document root <none> and password file <none>
I20260810 14:52:53.377562 23814 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:53.377609 23814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:53.377736 23814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:53.378763 23814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "ba64f367145949e3a392ff226c30d936"
format_stamp: "Formatted at 2026-08-10 14:52:53 on dist-test-slave-4tdj"
server_key: "baf12d435354262366d23c605eb517be"
server_key_iv: "fe378186c40f5d3056599fee21b9b43b"
server_key_version: "encryptionkey@0"
I20260810 14:52:53.379079 23814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "ba64f367145949e3a392ff226c30d936"
format_stamp: "Formatted at 2026-08-10 14:52:53 on dist-test-slave-4tdj"
server_key: "baf12d435354262366d23c605eb517be"
server_key_iv: "fe378186c40f5d3056599fee21b9b43b"
server_key_version: "encryptionkey@0"
I20260810 14:52:53.380246 23814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:53.380872 23836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:53.381011 23814 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:53.381083 23814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "ba64f367145949e3a392ff226c30d936"
format_stamp: "Formatted at 2026-08-10 14:52:53 on dist-test-slave-4tdj"
server_key: "baf12d435354262366d23c605eb517be"
server_key_iv: "fe378186c40f5d3056599fee21b9b43b"
server_key_version: "encryptionkey@0"
I20260810 14:52:53.381140 23814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:53.391955 23814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:53.393570 23814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:53.393705 23814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:53.397456 23814 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36441
I20260810 14:52:53.397486 23912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36441 every 8 connection(s)
I20260810 14:52:53.397794 23814 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:53.398711 23913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:53.399091 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23814
I20260810 14:52:53.399214 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:53.399415 19575 external_mini_cluster.cc:1428] Setting key 90db0769797e0c094cf8164a749f3d94
I20260810 14:52:53.401482 23913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936: Bootstrap starting.
I20260810 14:52:53.402041 23913 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:53.402313 23913 log.cc:824] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:53.403010 23913 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936: No bootstrap required, opened a new log
I20260810 14:52:53.405275 23913 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } }
I20260810 14:52:53.405400 23913 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:53.405421 23913 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba64f367145949e3a392ff226c30d936, State: Initialized, Role: FOLLOWER
I20260810 14:52:53.405531 23913 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } }
I20260810 14:52:53.405594 23913 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:53.405614 23913 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:53.405658 23913 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 0 FOLLOWER]: Advancing to term 1
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23794](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373573, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:53.406153 23913 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } }
I20260810 14:52:53.406237 23913 leader_election.cc:302] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba64f367145949e3a392ff226c30d936; no voters:
I20260810 14:52:53.406421 23913 leader_election.cc:288] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:53.406456 23924 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:53.406618 23924 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [term 1 LEADER]: Becoming Leader. State: Replica: ba64f367145949e3a392ff226c30d936, State: Running, Role: LEADER
I20260810 14:52:53.406678 23913 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:53.406724 23924 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } }
I20260810 14:52:53.407222 23926 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba64f367145949e3a392ff226c30d936. Latest consensus state: current_term: 1 leader_uuid: "ba64f367145949e3a392ff226c30d936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } } }
I20260810 14:52:53.407382 23925 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba64f367145949e3a392ff226c30d936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba64f367145949e3a392ff226c30d936" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36441 } } }
I20260810 14:52:53.407464 23926 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:53.407523 23925 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:53.407758 23939 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:53.408295 23939 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:53.409773 23939 catalog_manager.cc:1347] Generated new cluster ID: e7a65d0a25f8419d9972524066d8a335
I20260810 14:52:53.409819 23939 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:53.409850 23920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:53.399911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40563 (local address 127.19.29.254:36441)
0810 14:52:53.400065 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:53.400074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:53.400097 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:52:53.400490 (+ 393us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:53.400496 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:53.400538 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:53.400643 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:53.401369 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:53.402274 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:53.403189 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:53.403585 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:53.403664 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:53.406093 (+ 2429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:53.406098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:53.406098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:53.406109 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:53.408077 (+ 1968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:53.408456 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:53.408460 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:53.408460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:53.408557 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:53.408765 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:53.408767 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:53.408767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:53.409057 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:53.409179 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:53.409525 (+ 346us) server_negotiation.cc:299] Negotiation successful
0810 14:52:53.409658 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
I20260810 14:52:53.415122 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:53.423067 23920 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:53.416480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36059 (local address 127.19.29.254:36441)
0810 14:52:53.416517 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:53.416518 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:53.416628 (+ 110us) server_negotiation.cc:407] Connection header received
0810 14:52:53.416721 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:53.416722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:53.416731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:53.416795 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:53.417329 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:53.418067 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:53.419012 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:53.419333 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:53.419395 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:53.420560 (+ 1165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:53.420562 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:53.420562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:53.420569 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:53.422004 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:53.422382 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:53.422383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:53.422383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:53.422438 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:53.422604 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:53.422604 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:53.422605 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:53.422719 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:53.422814 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:53.422904 (+ 90us) server_negotiation.cc:299] Negotiation successful
0810 14:52:53.422974 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:53.431145 23939 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:53.431632 23939 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:53.433550 23939 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba64f367145949e3a392ff226c30d936: Generated new TSK 0
I20260810 14:52:53.433722 23939 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:53.436093 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23814
2026-08-10T14:52:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1443 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23970](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23970](info): set up 2 sockets
Aug 10 14:52:53 dist-test-slave-4tdj krb5kdc[23970](info): commencing operation
krb5kdc: starting...
W20260810 14:52:54.593091 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:54 dist-test-slave-4tdj krb5kdc[23970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373574, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:54.704396 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45299
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:40317
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:54.783696 23994 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:54.783885 23994 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:54.783914 23994 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:54.785024 23994 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:54.785064 23994 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:54.785084 23994 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:54.785099 23994 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:54.785115 23994 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:54.786600 23994 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:40317
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45299
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23994
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:54.786832 23994 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:54.787025 23994 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:54.791589 24006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:54.791576 24003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:54.791576 24002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:54.791697 23994 server_base.cc:1034] running on GCE node
I20260810 14:52:54.792007 23994 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:54.792284 23994 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:54.793407 23994 hybrid_clock.cc:648] HybridClock initialized: now 1786373574793393 us; error 32 us; skew 500 ppm
Aug 10 14:52:54 dist-test-slave-4tdj krb5kdc[23970](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373574, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:54.799929 23994 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:54.800333 23994 webserver.cc:460] Webserver started at http://127.19.29.254:42847/ using document root <none> and password file <none>
I20260810 14:52:54.800539 23994 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:54.800578 23994 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:54.800694 23994 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:54.801667 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "9517777f64b641a5851d24e5a5deeb3a"
format_stamp: "Formatted at 2026-08-10 14:52:54 on dist-test-slave-4tdj"
server_key: "f4b24948f4f9a771675a26d5b3f82b2f"
server_key_iv: "a52934877973f481d015a1f183c013a1"
server_key_version: "encryptionkey@0"
I20260810 14:52:54.801981 23994 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "9517777f64b641a5851d24e5a5deeb3a"
format_stamp: "Formatted at 2026-08-10 14:52:54 on dist-test-slave-4tdj"
server_key: "f4b24948f4f9a771675a26d5b3f82b2f"
server_key_iv: "a52934877973f481d015a1f183c013a1"
server_key_version: "encryptionkey@0"
I20260810 14:52:54.803251 23994 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:52:54.803908 24015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:54.804054 23994 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:54.804123 23994 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "9517777f64b641a5851d24e5a5deeb3a"
format_stamp: "Formatted at 2026-08-10 14:52:54 on dist-test-slave-4tdj"
server_key: "f4b24948f4f9a771675a26d5b3f82b2f"
server_key_iv: "a52934877973f481d015a1f183c013a1"
server_key_version: "encryptionkey@0"
I20260810 14:52:54.804203 23994 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:54.819511 23994 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:54.821173 23994 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:54.821295 23994 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:54.825201 23994 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45299
I20260810 14:52:54.825244 24099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45299 every 8 connection(s)
I20260810 14:52:54.825572 23994 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:54.826452 24100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:54.828651 24100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a: Bootstrap starting.
I20260810 14:52:54.828665 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 23994
I20260810 14:52:54.828752 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:54.828914 19575 external_mini_cluster.cc:1428] Setting key de986362ded38d5b4d700cff99d20105
I20260810 14:52:54.829310 24100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:54.829618 24100 log.cc:824] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:54.830281 24100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a: No bootstrap required, opened a new log
I20260810 14:52:54.832370 24100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } }
I20260810 14:52:54.832542 24100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:54.832582 24100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9517777f64b641a5851d24e5a5deeb3a, State: Initialized, Role: FOLLOWER
I20260810 14:52:54.832706 24100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } }
I20260810 14:52:54.832768 24100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:54.832790 24100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:54.832835 24100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:54.833457 24100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } }
I20260810 14:52:54.833572 24100 leader_election.cc:302] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9517777f64b641a5851d24e5a5deeb3a; no voters:
I20260810 14:52:54.833730 24100 leader_election.cc:288] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:54.833770 24107 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:54.833907 24107 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [term 1 LEADER]: Becoming Leader. State: Replica: 9517777f64b641a5851d24e5a5deeb3a, State: Running, Role: LEADER
I20260810 14:52:54.833987 24100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:54.834045 24107 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } }
I20260810 14:52:54.834445 24107 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9517777f64b641a5851d24e5a5deeb3a. Latest consensus state: current_term: 1 leader_uuid: "9517777f64b641a5851d24e5a5deeb3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } } }
I20260810 14:52:54.834452 24112 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9517777f64b641a5851d24e5a5deeb3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9517777f64b641a5851d24e5a5deeb3a" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45299 } } }
I20260810 14:52:54.834589 24107 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:54.834597 24112 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:54.834810 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:54.829394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53889 (local address 127.19.29.254:45299)
0810 14:52:54.829575 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:54.829583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:54.829608 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:52:54.830073 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:54.830080 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:54.830129 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:54.830242 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:54.830523 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:54.831469 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:54.832531 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:54.833082 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:54.833158 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:54.833920 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:54.833925 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:54.833925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:54.834113 (+ 188us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:54.834153 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:54.834170 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:54.834231 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:54.834529 (+ 298us) server_negotiation.cc:299] Negotiation successful
0810 14:52:54.834605 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260810 14:52:54.834841 24127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:54.835302 24127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:54.835728 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:54.837930 24127 catalog_manager.cc:1347] Generated new cluster ID: e5dffab321cd42d7984bbf25708165b5
I20260810 14:52:54.837984 24127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:54.839876 24105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:54.837211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52537 (local address 127.19.29.254:45299)
0810 14:52:54.837247 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:54.837249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:54.837258 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:54.837306 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:54.837306 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:54.837316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:54.837369 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:54.837544 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:54.838133 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:54.838883 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:54.839085 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:54.839137 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:54.839681 (+ 544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:54.839682 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:54.839682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:54.839686 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:54.839700 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:54.839703 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:54.839746 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:54.839791 (+ 45us) server_negotiation.cc:299] Negotiation successful
0810 14:52:54.839809 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:54.848227 24127 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:54.848922 24127 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:54.866950 24127 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9517777f64b641a5851d24e5a5deeb3a: Generated new TSK 0
I20260810 14:52:54.867121 24127 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:54.873071 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 23994
2026-08-10T14:52:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1430 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:54 dist-test-slave-4tdj krb5kdc[24159](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:54 dist-test-slave-4tdj krb5kdc[24159](info): set up 2 sockets
Aug 10 14:52:54 dist-test-slave-4tdj krb5kdc[24159](info): commencing operation
krb5kdc: starting...
W20260810 14:52:56.021206 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.126s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:56 dist-test-slave-4tdj krb5kdc[24159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373576, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:56.132292 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36035
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:36035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:56.211944 24180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:56.212142 24180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:56.212173 24180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:56.213282 24180 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:56.213322 24180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:56.213341 24180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:56.213357 24180 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:56.213372 24180 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:56.214864 24180 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:36035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:36035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24180
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:56.215114 24180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:56.215317 24180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:56.220011 24188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:56.220049 24187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:56.220057 24191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:56.220103 24180 server_base.cc:1034] running on GCE node
I20260810 14:52:56.220450 24180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:56.220753 24180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:56.221884 24180 hybrid_clock.cc:648] HybridClock initialized: now 1786373576221873 us; error 28 us; skew 500 ppm
Aug 10 14:52:56 dist-test-slave-4tdj krb5kdc[24159](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373576, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:56.224146 24180 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:56.224535 24180 webserver.cc:460] Webserver started at http://127.19.29.254:41273/ using document root <none> and password file <none>
I20260810 14:52:56.224752 24180 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:56.224795 24180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:56.224915 24180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:56.225907 24180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "95dbb452929f48d2adec498f4abb8849"
format_stamp: "Formatted at 2026-08-10 14:52:56 on dist-test-slave-4tdj"
server_key: "3e921266648094ab86b31d2ad2575d34"
server_key_iv: "23ace57797bf924f671adfe0ab0030e9"
server_key_version: "encryptionkey@0"
I20260810 14:52:56.226229 24180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "95dbb452929f48d2adec498f4abb8849"
format_stamp: "Formatted at 2026-08-10 14:52:56 on dist-test-slave-4tdj"
server_key: "3e921266648094ab86b31d2ad2575d34"
server_key_iv: "23ace57797bf924f671adfe0ab0030e9"
server_key_version: "encryptionkey@0"
I20260810 14:52:56.227434 24180 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260810 14:52:56.228091 24206 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:56.228240 24180 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:56.228322 24180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "95dbb452929f48d2adec498f4abb8849"
format_stamp: "Formatted at 2026-08-10 14:52:56 on dist-test-slave-4tdj"
server_key: "3e921266648094ab86b31d2ad2575d34"
server_key_iv: "23ace57797bf924f671adfe0ab0030e9"
server_key_version: "encryptionkey@0"
I20260810 14:52:56.228380 24180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:56.231594 24180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:56.233166 24180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:56.233284 24180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:56.237088 24180 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:36035
I20260810 14:52:56.237131 24297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:36035 every 8 connection(s)
I20260810 14:52:56.237402 24180 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:56.238375 24299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:56.240491 24299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849: Bootstrap starting.
I20260810 14:52:56.241036 24299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:56.241302 24299 log.cc:824] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:56.241909 24299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849: No bootstrap required, opened a new log
I20260810 14:52:56.243479 24299 raft_consensus.cc:348] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } }
I20260810 14:52:56.243609 24299 raft_consensus.cc:374] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260810 14:52:56.243630 24299 raft_consensus.cc:729] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95dbb452929f48d2adec498f4abb8849, State: Initialized, Role: FOLLOWER
I20260810 14:52:56.243765 24299 consensus_queue.cc:260] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } }
I20260810 14:52:56.243841 24299 raft_consensus.cc:388] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260810 14:52:56.243875 24299 raft_consensus.cc:482] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260810 14:52:56.243920 24299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:56.244719 24299 raft_consensus.cc:504] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } }
I20260810 14:52:56.244808 24299 leader_election.cc:302] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 95dbb452929f48d2adec498f4abb8849; no voters:
I20260810 14:52:56.244948 24299 leader_election.cc:288] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260810 14:52:56.245040 24304 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:56.245196 24299 sys_catalog.cc:564] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:56.245205 24304 raft_consensus.cc:686] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [term 1 LEADER]: Becoming Leader. State: Replica: 95dbb452929f48d2adec498f4abb8849, State: Running, Role: LEADER
I20260810 14:52:56.245332 24304 consensus_queue.cc:237] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } }
I20260810 14:52:56.245719 24305 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "95dbb452929f48d2adec498f4abb8849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } } }
I20260810 14:52:56.245810 24305 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:56.245997 24306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 95dbb452929f48d2adec498f4abb8849. Latest consensus state: current_term: 1 leader_uuid: "95dbb452929f48d2adec498f4abb8849" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "95dbb452929f48d2adec498f4abb8849" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 36035 } } }
I20260810 14:52:56.246076 24318 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:56.246551 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24180
I20260810 14:52:56.246665 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:56.246873 19575 external_mini_cluster.cc:1428] Setting key 14b8384c4eaabe81ac993700f87d771e
I20260810 14:52:56.246932 24318 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:56.247114 24306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:56.249051 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:56.247352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55305 (local address 127.19.29.254:36035)
0810 14:52:56.247574 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:56.247583 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:56.247619 (+ 36us) server_negotiation.cc:407] Connection header received
0810 14:52:56.247734 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:56.247741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:56.247771 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:56.247917 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:56.248590 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:56.248594 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:56.248594 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:56.248599 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:56.248654 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:56.248670 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:56.248752 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:56.248826 (+ 74us) server_negotiation.cc:299] Negotiation successful
0810 14:52:56.248870 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":101,"threads_started":1}
I20260810 14:52:56.249150 24318 catalog_manager.cc:1347] Generated new cluster ID: 0a4ae4557a654ff9ade9604b631383a5
I20260810 14:52:56.249275 24318 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:56.250125 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:56.252592 24340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:56.251614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40509 (local address 127.19.29.254:36035)
0810 14:52:56.251650 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:56.251651 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:56.251724 (+ 73us) server_negotiation.cc:407] Connection header received
0810 14:52:56.251786 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:56.251787 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:56.251792 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:56.251853 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:56.252384 (+ 531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:56.252385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:56.252386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0810 14:52:56.252390 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:56.252405 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0810 14:52:56.252409 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:56.252471 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:56.252519 (+ 48us) server_negotiation.cc:299] Negotiation successful
0810 14:52:56.252531 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:56.264238 24318 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:56.264400 24318 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:52:56.269169 24318 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 95dbb452929f48d2adec498f4abb8849: Generated new TSK 0
I20260810 14:52:56.269337 24318 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:56.279691 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24180
2026-08-10T14:52:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1410 ms)
[----------] 18 tests from AuthTokenIssuingTest (25880 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:56 dist-test-slave-4tdj krb5kdc[24352](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:56 dist-test-slave-4tdj krb5kdc[24352](info): set up 2 sockets
Aug 10 14:52:56 dist-test-slave-4tdj krb5kdc[24352](info): commencing operation
krb5kdc: starting...
W20260810 14:52:57.438582 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.132s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:52:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:52:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:52:57.552175 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37055
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:52:57.632102 24374 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:52:57.632325 24374 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:57.632349 24374 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:57.632375 24374 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:57.633513 24374 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:57.633555 24374 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:57.633574 24374 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:57.633589 24374 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:57.633603 24374 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:57.635237 24374 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:37055
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24374
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:57.635493 24374 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:57.635700 24374 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:57.640457 24382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:57.640507 24386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:57.640568 24374 server_base.cc:1034] running on GCE node
W20260810 14:52:57.640512 24384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:57.640938 24374 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:57.641233 24374 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:57.642352 24374 hybrid_clock.cc:648] HybridClock initialized: now 1786373577642333 us; error 33 us; skew 500 ppm
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:57.644728 24374 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:52:57.645148 24374 webserver.cc:460] Webserver started at http://127.19.29.254:39547/ using document root <none> and password file <none>
I20260810 14:52:57.645382 24374 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:57.645431 24374 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:57.645557 24374 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:57.646714 24374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "3f0395824c02475394966521403dfa96"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "f6f2dcc5a97bdc42f5cc7693d92e837a"
server_key_iv: "821fdae274d8034d0ecba94d298e4e9e"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.647071 24374 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "3f0395824c02475394966521403dfa96"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "f6f2dcc5a97bdc42f5cc7693d92e837a"
server_key_iv: "821fdae274d8034d0ecba94d298e4e9e"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.648319 24374 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:52:57.648963 24394 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:57.649119 24374 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:57.649206 24374 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "3f0395824c02475394966521403dfa96"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "f6f2dcc5a97bdc42f5cc7693d92e837a"
server_key_iv: "821fdae274d8034d0ecba94d298e4e9e"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.649267 24374 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:57.677846 24374 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:57.680075 24374 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:57.680222 24374 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:57.684095 24374 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:37055
I20260810 14:52:57.684141 24499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:37055 every 8 connection(s)
I20260810 14:52:57.684469 24374 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:52:57.685459 24500 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:57.686842 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24374
I20260810 14:52:57.686946 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:52:57.687114 19575 external_mini_cluster.cc:1428] Setting key dcd8f6ef8351f668dfe65cb9f304a950
I20260810 14:52:57.687114 24500 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.29.253@KRBTEST.COM; defaulting to no policy
I20260810 14:52:57.696197 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.687817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44774 (local address 127.19.29.254:37055)
0810 14:52:57.688003 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.688007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.688070 (+ 63us) server_negotiation.cc:407] Connection header received
0810 14:52:57.688627 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.688629 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.688648 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.688723 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.689239 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.690049 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.690933 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.691300 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.691398 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.693309 (+ 1911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.693316 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.693317 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.693323 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.694756 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.695106 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.695109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.695110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.695194 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.695383 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.695384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.695384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.695581 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.695652 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.695838 (+ 186us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.695962 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":163,"thread_start_us":86,"threads_started":1}
I20260810 14:52:57.696200 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.687783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37055 (local address 127.0.0.1:44774)
0810 14:52:57.687943 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.687986 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.688474 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.688734 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.688737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.688997 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.689144 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.689148 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.690136 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.690137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.690855 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.690857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.691392 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.691393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.691455 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.691950 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.691959 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.693232 (+ 1273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.694827 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.694833 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.694835 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.695036 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.695249 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.695250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.695251 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.695331 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.695639 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.695644 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.695713 (+ 69us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.695828 (+ 115us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.696015 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"mutex_wait_us":71,"thread_start_us":75,"threads_started":1}
I20260810 14:52:57.696928 24500 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.697250 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.697150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:45196)
0810 14:52:57.697188 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.697230 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 14:52:57.697367 24397 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.253@KRBTEST.COM" created.
I20260810 14:52:57.697791 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.697702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:45204)
0810 14:52:57.697742 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.697770 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:52:57.697888 24500 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43493: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
I20260810 14:52:57.711076 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:43493
--webserver_interface=127.19.29.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:52:57.747130 24500 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } attempt: 1
I20260810 14:52:57.747644 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.747491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:45212)
0810 14:52:57.747576 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.747613 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260810 14:52:57.748041 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.747894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:45226)
0810 14:52:57.747954 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.748009 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260810 14:52:57.748155 24500 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43493: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
W20260810 14:52:57.792695 24512 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:52:57.792893 24512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:57.792909 24512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:57.792928 24512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:57.794042 24512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:57.794082 24512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:57.794095 24512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:57.794106 24512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:57.794116 24512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:57.795642 24512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:43493
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.29.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:57.795867 24512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:57.796077 24512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:52:57.800763 24524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:57.800750 24521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:57.800772 24522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:57.800927 24512 server_base.cc:1034] running on GCE node
I20260810 14:52:57.801185 24512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:57.801426 24512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:57.802593 24512 hybrid_clock.cc:648] HybridClock initialized: now 1786373577802574 us; error 37 us; skew 500 ppm
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:57.805088 24512 init.cc:377] Logged in from keytab as kudu/127.19.29.253@KRBTEST.COM (short username kudu)
I20260810 14:52:57.805537 24512 webserver.cc:460] Webserver started at http://127.19.29.253:46859/ using document root <none> and password file <none>
I20260810 14:52:57.805876 24512 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:57.805936 24512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:57.806038 24512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:57.807120 24512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data/instance:
uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "8dd6f67e7baa2362e0f5701cbc667c90"
server_key_iv: "a691068d74d66256d8527d888acbcdd3"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.807447 24512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal/instance:
uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "8dd6f67e7baa2362e0f5701cbc667c90"
server_key_iv: "a691068d74d66256d8527d888acbcdd3"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.808638 24512 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260810 14:52:57.809284 24533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:57.809446 24512 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:52:57.809530 24512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "8dd6f67e7baa2362e0f5701cbc667c90"
server_key_iv: "a691068d74d66256d8527d888acbcdd3"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.809592 24512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:57.816296 24500 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } attempt: 2
I20260810 14:52:57.816697 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.816570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:58956)
0810 14:52:57.816626 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.816666 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260810 14:52:57.817020 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.816903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:58970)
0810 14:52:57.816962 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.816993 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260810 14:52:57.817109 24500 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:43493: Network error: Client connection negotiation failed: client connection to 127.19.29.253:43493: connect: Connection refused (error 111)
I20260810 14:52:57.819720 24512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:57.821676 24512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:57.821805 24512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:57.825518 24512 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.253:43493
I20260810 14:52:57.825575 24617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.253:43493 every 8 connection(s)
I20260810 14:52:57.825870 24512 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
I20260810 14:52:57.826903 24618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:57.828377 24618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:57.835798 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24512
I20260810 14:52:57.835896 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-1/wal/instance
I20260810 14:52:57.836091 19575 external_mini_cluster.cc:1428] Setting key a7fcdc5451800948cadf5a36964c56ba
I20260810 14:52:57.836683 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.829038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53500 (local address 127.19.29.254:37055)
0810 14:52:57.829093 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.829095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.829295 (+ 200us) server_negotiation.cc:407] Connection header received
0810 14:52:57.829745 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.829746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.829755 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.829806 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.830366 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.830859 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.831814 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.832020 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.832083 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.833999 (+ 1916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.834000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.834000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.834008 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.835308 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.835742 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.835744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.835744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.835812 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.836060 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.836062 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.836062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.836200 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.836270 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.836518 (+ 248us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.836600 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260810 14:52:57.836845 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.828997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37055 (local address 127.0.0.1:53500)
0810 14:52:57.829181 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.829222 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.829672 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.829858 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.829861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.830083 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.830269 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.830273 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.830934 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.830935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.831717 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.831720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.832095 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.832095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.832194 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.832601 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.832608 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.833903 (+ 1295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.835393 (+ 1490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.835400 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.835402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.835659 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.835879 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.835879 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.835880 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.835996 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.836263 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.836269 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.836380 (+ 111us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.836461 (+ 81us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.836636 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":97,"threads_started":1}
I20260810 14:52:57.837502 24618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.29.252@KRBTEST.COM; defaulting to no policy
I20260810 14:52:57.844143 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.837776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:58980)
0810 14:52:57.837818 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.837827 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.837862 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.838084 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.838085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.838198 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.838238 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.838240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.839137 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.839138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.839612 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.839614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.840047 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.840048 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.840108 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.840482 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.840486 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.841604 (+ 1118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.843197 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.843198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.843198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.843347 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.843529 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.843529 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.843530 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.843583 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.843834 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.843835 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.843871 (+ 36us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.843937 (+ 66us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.844036 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 14:52:57.844206 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.837834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58980 (local address 127.19.29.253:43493)
0810 14:52:57.837953 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.837957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.837974 (+ 17us) server_negotiation.cc:407] Connection header received
0810 14:52:57.838002 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.838004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.838014 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.838071 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.838320 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.839053 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.839678 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.839986 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.840042 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.841680 (+ 1638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.841689 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.841689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.841696 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.843119 (+ 1423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.843412 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.843416 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.843416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.843467 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.843631 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.843632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.843632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.843771 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.843844 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.843971 (+ 127us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.844087 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":96,"thread_start_us":74,"threads_started":1}
I20260810 14:52:57.844810 24618 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.845140 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.845045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41124)
0810 14:52:57.845078 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.845121 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260810 14:52:57.845270 24538 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
I20260810 14:52:57.845665 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.845577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41136)
0810 14:52:57.845618 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.845642 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:52:57.845757 24618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:39163: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
I20260810 14:52:57.861713 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:39163
--webserver_interface=127.19.29.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:45123
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:52:57.894955 24618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } attempt: 1
I20260810 14:52:57.895475 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.895323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41142)
0810 14:52:57.895396 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.895445 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260810 14:52:57.895792 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.895710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41150)
0810 14:52:57.895748 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.895773 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:52:57.895888 24618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:39163: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
I20260810 14:52:57.908237 24500 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } attempt: 3
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:52:57.915098 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.908523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:58988)
0810 14:52:57.908581 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.908595 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.908658 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.908807 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.908807 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.908998 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.909077 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.909079 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.909681 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.909682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.910555 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.910558 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.910911 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.910912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.910990 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.911391 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.911397 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.912690 (+ 1293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.914155 (+ 1465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.914156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.914157 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.914360 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.914529 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.914530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.914530 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.914586 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.914799 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.914800 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.914847 (+ 47us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.914906 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.915003 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260810 14:52:57.915097 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.908586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58988 (local address 127.19.29.253:43493)
0810 14:52:57.908633 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.908635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.908644 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:57.908732 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.908732 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.908743 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.908789 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.909139 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.909619 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.910625 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.910849 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.910899 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.912791 (+ 1892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.912792 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.912792 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.912799 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.914077 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.914419 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.914420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.914421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.914476 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.914634 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.914635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.914636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.914745 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.914798 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.914935 (+ 137us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.915003 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:52:57.915421 24500 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.915712 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.915632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41152)
0810 14:52:57.915663 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.915689 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
I20260810 14:52:57.915972 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.915893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41164)
0810 14:52:57.915929 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.915952 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 14:52:57.916034 24500 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:39163: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
W20260810 14:52:57.943380 24632 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:52:57.943564 24632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:52:57.943580 24632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:52:57.943629 24632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:52:57.944762 24632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:52:57.944802 24632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:52:57.944815 24632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:52:57.944837 24632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:52:57.944859 24632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:52:57.946382 24632 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:45123
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:37055,127.19.29.253:43493,127.19.29.252:39163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:39163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.29.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:52:57.946604 24632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:52:57.946805 24632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:52:57.947149 24500 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } attempt: 1
I20260810 14:52:57.947531 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.947384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41180)
0810 14:52:57.947443 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.947496 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260810 14:52:57.947866 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.947767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41182)
0810 14:52:57.947811 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.947844 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 14:52:57.947964 24500 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:39163: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
W20260810 14:52:57.951505 24650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:57.951527 24641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:52:57.951532 24639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:52:57.951678 24632 server_base.cc:1034] running on GCE node
I20260810 14:52:57.951921 24632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:52:57.952160 24632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:52:57.953305 24632 hybrid_clock.cc:648] HybridClock initialized: now 1786373577953290 us; error 28 us; skew 500 ppm
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:52:57.955628 24632 init.cc:377] Logged in from keytab as kudu/127.19.29.252@KRBTEST.COM (short username kudu)
I20260810 14:52:57.956013 24632 webserver.cc:460] Webserver started at http://127.19.29.252:41655/ using document root <none> and password file <none>
I20260810 14:52:57.956225 24632 fs_manager.cc:359] Metadata directory not provided
I20260810 14:52:57.956264 24632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:52:57.956351 24632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:52:57.957281 24632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data/instance:
uuid: "97745ef5c732479e8583135a4349962f"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "9be4fbd29ac9898c29ba1292ef46f530"
server_key_iv: "70329b2fc4d8a466bea579a1dbb29ac7"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.957557 24632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal/instance:
uuid: "97745ef5c732479e8583135a4349962f"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "9be4fbd29ac9898c29ba1292ef46f530"
server_key_iv: "70329b2fc4d8a466bea579a1dbb29ac7"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.958731 24632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:52:57.959333 24667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:52:57.959483 24632 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:52:57.959563 24632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "97745ef5c732479e8583135a4349962f"
format_stamp: "Formatted at 2026-08-10 14:52:57 on dist-test-slave-4tdj"
server_key: "9be4fbd29ac9898c29ba1292ef46f530"
server_key_iv: "70329b2fc4d8a466bea579a1dbb29ac7"
server_key_version: "encryptionkey@0"
I20260810 14:52:57.959616 24632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:52:57.964027 24618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } attempt: 2
I20260810 14:52:57.964352 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.964251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41194)
0810 14:52:57.964299 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.964326 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260810 14:52:57.964679 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.964599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41202)
0810 14:52:57.964630 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.964653 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260810 14:52:57.964754 24618 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:39163: Network error: Client connection negotiation failed: client connection to 127.19.29.252:39163: connect: Connection refused (error 111)
I20260810 14:52:57.966861 24632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:52:57.968350 24632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:52:57.968447 24632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:52:57.972008 24632 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.252:39163
I20260810 14:52:57.972045 24753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.252:39163 every 8 connection(s)
I20260810 14:52:57.972349 24632 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
I20260810 14:52:57.973248 24754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:52:57.974681 24754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.976370 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 24632
I20260810 14:52:57.976472 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786373310130398-19575-0/minicluster-data/master-2/wal/instance
I20260810 14:52:57.976662 19575 external_mini_cluster.cc:1428] Setting key b1ced1f8b0e3a3a6039038b8c56cdf1a
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:52:57.983459 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.975265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53508 (local address 127.19.29.254:37055)
0810 14:52:57.975315 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.975317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.975508 (+ 191us) server_negotiation.cc:407] Connection header received
0810 14:52:57.975961 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.975962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.975975 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.976021 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.976761 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.977300 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.978434 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.978627 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.978681 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.980806 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.980808 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.980808 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.980816 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.982059 (+ 1243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.982506 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.982507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.982508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.982574 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.982835 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.982836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.982836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.982969 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.983038 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.983294 (+ 256us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.983371 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:52:57.983582 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.975244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:37055 (local address 127.0.0.1:53508)
0810 14:52:57.975404 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.975436 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.975871 (+ 435us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.976093 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.976096 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.976373 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.976639 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.976645 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.977383 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.977384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.978363 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.978366 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.978712 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.978713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.978842 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.979310 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.979318 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.980709 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.982134 (+ 1425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.982143 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.982145 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.982441 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.982637 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.982637 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.982638 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.982767 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.983030 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.983034 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.983148 (+ 114us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.983265 (+ 117us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.983414 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260810 14:52:57.984090 24754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.985194 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.977020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41210 (local address 127.19.29.252:39163)
0810 14:52:57.977280 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.977283 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.977298 (+ 15us) server_negotiation.cc:407] Connection header received
0810 14:52:57.977315 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.977317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.977331 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.977399 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.977961 (+ 562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.978869 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.979661 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.980006 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.980057 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.982375 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.982383 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.982383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.982389 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.983994 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.984503 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.984505 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.984505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.984564 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.984737 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.984737 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.984738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.984880 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.984976 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.985076 (+ 100us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.985131 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":85,"threads_started":1}
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:52:57.990470 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.984312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:43493 (local address 127.0.0.1:59002)
0810 14:52:57.984344 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.984355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.984392 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.984548 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.984549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.984681 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.984712 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.984713 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.985480 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.985481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.986068 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.986070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.986457 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.986458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.986514 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.986895 (+ 381us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.986900 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.987973 (+ 1073us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.989556 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.989557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.989557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.989736 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.989927 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.989927 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.989927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.989978 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.990189 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.990190 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.990232 (+ 42us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.990286 (+ 54us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.990386 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260810 14:52:57.990506 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.984392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59002 (local address 127.19.29.253:43493)
0810 14:52:57.984438 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.984440 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.984446 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:52:57.984470 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.984471 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.984480 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.984530 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.984778 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.985410 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.986140 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.986394 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.986446 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.988057 (+ 1611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.988058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.988059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.988065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.989478 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.989806 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.989807 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.989808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.989867 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.990034 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.990035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.990035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.990132 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.990186 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.990343 (+ 157us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.990420 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:52:57.990828 24754 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:52:57.992484 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.985925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53510 (local address 127.19.29.254:37055)
0810 14:52:57.985958 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.985960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.985968 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:57.986013 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.986013 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.986027 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.986067 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.986569 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.987037 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.987741 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.987963 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.988015 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.989980 (+ 1965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.989981 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.989982 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.989988 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.991629 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.991900 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.991901 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.991901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.991954 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.992092 (+ 138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.992092 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.992093 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.992189 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.992297 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.992376 (+ 79us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.992429 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
Aug 10 14:52:57 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:52:57.996721 24757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.991036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41214)
0810 14:52:57.991062 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:57.991070 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:57.991104 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:57.991227 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:57.991228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:57.991324 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:57.991350 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.991351 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.992086 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.992087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.992743 (+ 656us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:57.992746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.993184 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.993185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:57.993219 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.993530 (+ 311us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:57.993534 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:57.994533 (+ 999us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:57.995893 (+ 1360us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.995894 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.995894 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.996042 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.996196 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:57.996196 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:57.996197 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:57.996247 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:57.996437 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:57.996438 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:57.996472 (+ 34us) client_negotiation.cc:769] Sending connection context
0810 14:52:57.996540 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:52:57.996634 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13}
I20260810 14:52:57.996804 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.991065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41214 (local address 127.19.29.252:39163)
0810 14:52:57.991120 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.991122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.991132 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:57.991151 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.991152 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.991162 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.991225 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.991407 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.992003 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.992820 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.993089 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.993144 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.994601 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.994602 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.994602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.994608 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.995823 (+ 1215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.996097 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.996098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.996098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.996145 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.996294 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.996295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.996295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.996386 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.996435 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.996560 (+ 125us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.996726 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":89,"server-negotiator.queue_time_us":32}
I20260810 14:52:57.997951 24754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: Bootstrap starting.
I20260810 14:52:57.998817 24754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:57.999089 24754 log.cc:824] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:57.999620 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:57.993150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59018 (local address 127.19.29.253:43493)
0810 14:52:57.993187 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:57.993189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:57.993231 (+ 42us) server_negotiation.cc:407] Connection header received
0810 14:52:57.993294 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:57.993295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:57.993303 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:57.993397 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:57.993812 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.994236 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.994866 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:57.995055 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:57.995105 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:57.997025 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:57.997026 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:57.997027 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:57.997034 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:57.998509 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.998849 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.998850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.998850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.998901 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:57.999077 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:57.999078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:57.999078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:57.999194 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:57.999337 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:57.999371 (+ 34us) server_negotiation.cc:299] Negotiation successful
0810 14:52:57.999436 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:52:57.999752 24754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: No bootstrap required, opened a new log
I20260810 14:52:58.000886 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:52:58.001572 24754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.001736 24754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97745ef5c732479e8583135a4349962f, State: Initialized, Role: FOLLOWER
I20260810 14:52:58.001823 24754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.002151 24754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:58.002099 24763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.002209 24763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.002195 24451 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "3f0395824c02475394966521403dfa96"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53510
W20260810 14:52:58.003870 24781 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:52:58.003927 24781 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:52:58.004096 24632 master_runner.cc:186] Error getting master registration for 127.19.29.254:37055: OK, instance_id { permanent_uuid: "3f0395824c02475394966521403dfa96" instance_seqno: 1786373577683040 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:52:58.006974 24632 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:52:58.023069 24500 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } attempt: 2
Aug 10 14:52:58 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:52:58.030764 24503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.023344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41216)
0810 14:52:58.023393 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:58.023419 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:58.023479 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:58.023622 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:58.023623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:58.023815 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:58.023869 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:58.023871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.024761 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.024762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:58.025600 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:58.025603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.026034 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.026034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:58.026093 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.026576 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:58.026581 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:58.028072 (+ 1491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:58.029731 (+ 1659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:58.029732 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:58.029733 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:58.029950 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:58.030126 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:58.030127 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:58.030127 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:58.030184 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:58.030467 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:58.030468 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:58.030514 (+ 46us) client_negotiation.cc:769] Sending connection context
0810 14:52:58.030574 (+ 60us) client_negotiation.cc:240] Negotiation successful
0810 14:52:58.030674 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 14:52:58.030763 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.023413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41216 (local address 127.19.29.252:39163)
0810 14:52:58.023463 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.023464 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.023473 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:52:58.023547 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.023547 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.023556 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.023612 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.023940 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.024684 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.025671 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.025969 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.026024 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.028172 (+ 2148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:58.028174 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:58.028174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:58.028181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:58.029668 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.030019 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.030020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.030021 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.030071 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.030233 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.030234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.030234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.030407 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:58.030466 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:58.030602 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 14:52:58.030672 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:52:58.032009 24500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: Bootstrap starting.
I20260810 14:52:58.032614 24500 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:58.032874 24500 log.cc:824] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:58.033543 24500 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: No bootstrap required, opened a new log
I20260810 14:52:58.034880 24500 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.035015 24500 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f0395824c02475394966521403dfa96, State: Initialized, Role: FOLLOWER
I20260810 14:52:58.035085 24500 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.035344 24789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.035409 24500 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:58.035423 24789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.035538 24451 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 14:52:58.035621 24451 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:58.036386 24451 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
W20260810 14:52:58.037384 24804 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:52:58.037474 24804 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:52:58.037860 24713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3f0395824c02475394966521403dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "97745ef5c732479e8583135a4349962f"
I20260810 14:52:58.037976 24713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:58.038841 24713 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0395824c02475394966521403dfa96 in term 1.
I20260810 14:52:58.039129 24397 leader_election.cc:302] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f0395824c02475394966521403dfa96, 97745ef5c732479e8583135a4349962f; no voters:
I20260810 14:52:58.039243 24789 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:52:58.039386 24789 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [term 1 LEADER]: Becoming Leader. State: Replica: 3f0395824c02475394966521403dfa96, State: Running, Role: LEADER
I20260810 14:52:58.039464 24789 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.039901 24789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f0395824c02475394966521403dfa96. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.039986 24789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:58.038090 24374 master_runner.cc:186] Error getting master registration for 127.19.29.253:43493: OK, instance_id { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" instance_seqno: 1786373577824531 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:52:58.040341 24374 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:52:58.040431 24451 leader_election.cc:288] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [CANDIDATE]: Term 1 election: Requested vote from peers 8b123e9b3a1f4b57a1a357bfe2a9799e (127.19.29.253:43493), 97745ef5c732479e8583135a4349962f (127.19.29.252:39163)
I20260810 14:52:58.048645 24808 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:52:58.048868 24808 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:52:58.050782 24506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.041551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53522 (local address 127.19.29.254:37055)
0810 14:52:58.041586 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.041588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.042122 (+ 534us) server_negotiation.cc:407] Connection header received
0810 14:52:58.042217 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.042218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.042228 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.042255 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.043018 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.043705 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.044770 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.045078 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.045117 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.046615 (+ 1498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:58.046616 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:58.046617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:58.046624 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:58.048573 (+ 1949us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.049702 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.049703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.049704 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.049762 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.050051 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.050052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.050052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.050187 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:58.050259 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:58.050618 (+ 359us) server_negotiation.cc:299] Negotiation successful
0810 14:52:58.050703 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:58.053174 24626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.041525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59026 (local address 127.19.29.253:43493)
0810 14:52:58.041567 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.041569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.041980 (+ 411us) server_negotiation.cc:407] Connection header received
0810 14:52:58.042112 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.042113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.042125 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.042155 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.043323 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.044048 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.045568 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.046540 (+ 972us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.046586 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.048696 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:58.048697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:58.048698 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:58.048705 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:58.050489 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.051798 (+ 1309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.051799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.051800 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.051863 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.052230 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.052231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.052231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.052364 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:58.052431 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:58.052982 (+ 551us) server_negotiation.cc:299] Negotiation successful
0810 14:52:58.053079 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260810 14:52:58.054872 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.041842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41230 (local address 127.19.29.252:39163)
0810 14:52:58.041876 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.041877 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.046430 (+ 4553us) server_negotiation.cc:407] Connection header received
0810 14:52:58.046537 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.046538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.046549 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.046577 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.047146 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.047829 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.048550 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.048801 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.048861 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.051829 (+ 2968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:58.051830 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:58.051830 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:58.051837 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:58.053618 (+ 1781us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.054006 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.054007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.054007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.054079 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.054260 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.054276 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.054276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.054430 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:58.054512 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:58.054714 (+ 202us) server_negotiation.cc:299] Negotiation successful
0810 14:52:58.054784 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:52:58.055879 24618 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } attempt: 3
Aug 10 14:52:58 dist-test-slave-4tdj krb5kdc[24352](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373577, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:52:58.063199 24713 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [term 1 FOLLOWER]: Refusing update from remote peer 3f0395824c02475394966521403dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:58.063522 24789 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:58.063671 24622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.056106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:39163 (local address 127.0.0.1:41242)
0810 14:52:58.056155 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:52:58.056166 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:52:58.056204 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:52:58.056330 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:52:58.056330 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:52:58.056477 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:52:58.056516 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:58.056518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.057362 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.057363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:58.058153 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:52:58.058155 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.058626 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.058627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:52:58.058706 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.059076 (+ 370us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:52:58.059080 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:52:58.060510 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:52:58.062575 (+ 2065us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:58.062576 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:58.062576 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:58.062789 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:58.062981 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:52:58.062982 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:52:58.062982 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:52:58.063035 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:52:58.063375 (+ 340us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:52:58.063376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:52:58.063419 (+ 43us) client_negotiation.cc:769] Sending connection context
0810 14:52:58.063475 (+ 56us) client_negotiation.cc:240] Negotiation successful
0810 14:52:58.063566 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:52:58.064138 24760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:58.056191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41242 (local address 127.19.29.252:39163)
0810 14:52:58.056223 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.056225 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.056245 (+ 20us) server_negotiation.cc:407] Connection header received
0810 14:52:58.056263 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.056264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.056273 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.056312 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.056588 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.057285 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.058231 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:58.058546 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:58.058607 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:58.060590 (+ 1983us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:52:58.060591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:52:58.060591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:52:58.060598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:52:58.062490 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.062865 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.062867 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.062867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.062919 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:52:58.063093 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:52:58.063094 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:52:58.063094 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:52:58.063219 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:52:58.063356 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:58.063986 (+ 630us) server_negotiation.cc:299] Negotiation successful
0810 14:52:58.064055 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:58.066031 24763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f0395824c02475394966521403dfa96. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.066121 24763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.067595 24618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: Bootstrap starting.
I20260810 14:52:58.068161 24789 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.068243 24789 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: This master's current role is: LEADER
I20260810 14:52:58.068300 24618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: Neither blocks nor log segments found. Creating new log.
I20260810 14:52:58.068576 24618 log.cc:824] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: Log is configured to *not* fsync() on all Append() calls
I20260810 14:52:58.068719 24763 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.068799 24763 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.069150 24819 mvcc.cc:205] Tried to move back new op lower bound from 7316986175744389120 to 7316986175650459648. Current Snapshot: MvccSnapshot[applied={T|T < 7316986175744389120}]
I20260810 14:52:58.074674 24808 catalog_manager.cc:1347] Generated new cluster ID: 837b0f79bef74e679e6ab97cdc4bf387
I20260810 14:52:58.074726 24808 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:52:58.075285 24618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: No bootstrap required, opened a new log
I20260810 14:52:58.077989 24618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.078120 24618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b123e9b3a1f4b57a1a357bfe2a9799e, State: Initialized, Role: FOLLOWER
I20260810 14:52:58.078186 24618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } }
I20260810 14:52:58.078514 24618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:52:58.079388 24579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3f0395824c02475394966521403dfa96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e"
I20260810 14:52:58.079502 24579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:52:58.080340 24579 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f0395824c02475394966521403dfa96 in term 1.
I20260810 14:52:58.080603 24808 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:52:58.080858 24577 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [term 1 FOLLOWER]: Refusing update from remote peer 3f0395824c02475394966521403dfa96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:52:58.081183 24789 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:52:58.081295 24808 catalog_manager.cc:1504] Loading token signing keys...
W20260810 14:52:58.081823 24847 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:52:58.081876 24847 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:52:58.082933 24851 mvcc.cc:205] Tried to move back new op lower bound from 7316986175812575232 to 7316986175650459648. Current Snapshot: MvccSnapshot[applied={T|T < 7316986175744389120}]
I20260810 14:52:58.083083 24849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.083194 24849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.083269 24849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f0395824c02475394966521403dfa96. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.083350 24849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.083405 24849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.083477 24849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:52:58.085180 24808 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96: Generated new TSK 0
I20260810 14:52:58.085389 24808 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:52:58.091068 24806 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3f0395824c02475394966521403dfa96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f0395824c02475394966521403dfa96" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 37055 } } peers { permanent_uuid: "8b123e9b3a1f4b57a1a357bfe2a9799e" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 43493 } } peers { permanent_uuid: "97745ef5c732479e8583135a4349962f" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 39163 } } }
I20260810 14:52:58.091169 24806 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f0395824c02475394966521403dfa96 [sys.catalog]: This master's current role is: LEADER
W20260810 14:52:58.114279 24506 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.112598 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53530 (local address 127.19.29.254:37055)
0810 14:52:58.112641 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.112643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.113594 (+ 951us) server_negotiation.cc:407] Connection header received
0810 14:52:58.113701 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.113702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.113714 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.113744 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.114210 (+ 466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53530: BlockingRecv error: recv got EOF from 127.0.0.1:53530 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260810 14:52:58.115072 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.112991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59034 (local address 127.19.29.253:43493)
0810 14:52:58.113039 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.113041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.114551 (+ 1510us) server_negotiation.cc:407] Connection header received
0810 14:52:58.114646 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.114647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.114658 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.114686 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.115000 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59034: BlockingRecv error: recv got EOF from 127.0.0.1:59034 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
W20260810 14:52:58.115778 24760 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.113310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41244 (local address 127.19.29.252:39163)
0810 14:52:58.113351 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.113353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.115296 (+ 1943us) server_negotiation.cc:407] Connection header received
0810 14:52:58.115390 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.115391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.115401 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.115428 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.115725 (+ 297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41244: BlockingRecv error: recv got EOF from 127.0.0.1:41244 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260810 14:52:58.119664 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.118883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59042 (local address 127.19.29.253:43493)
0810 14:52:58.118918 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.118919 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.119149 (+ 230us) server_negotiation.cc:407] Connection header received
0810 14:52:58.119256 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.119257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.119276 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.119305 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.119621 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59042: BlockingRecv error: recv got EOF from 127.0.0.1:59042 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:52:58.122637 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.121845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59058 (local address 127.19.29.253:43493)
0810 14:52:58.121875 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.121877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.122113 (+ 236us) server_negotiation.cc:407] Connection header received
0810 14:52:58.122206 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.122207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.122216 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.122243 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.122598 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59058: BlockingRecv error: recv got EOF from 127.0.0.1:59058 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260810 14:52:58.126523 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.125736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59068 (local address 127.19.29.253:43493)
0810 14:52:58.125782 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.125783 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.125999 (+ 216us) server_negotiation.cc:407] Connection header received
0810 14:52:58.126104 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.126105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.126115 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.126141 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.126486 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59068: BlockingRecv error: recv got EOF from 127.0.0.1:59068 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:52:58.132290 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.131577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59078 (local address 127.19.29.253:43493)
0810 14:52:58.131610 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.131612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.131817 (+ 205us) server_negotiation.cc:407] Connection header received
0810 14:52:58.131901 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.131902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.131912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.131937 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.132251 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59078: BlockingRecv error: recv got EOF from 127.0.0.1:59078 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 14:52:58.142212 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.141411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59092 (local address 127.19.29.253:43493)
0810 14:52:58.141446 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.141448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.141684 (+ 236us) server_negotiation.cc:407] Connection header received
0810 14:52:58.141776 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.141777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.141788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.141815 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.142168 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59092: BlockingRecv error: recv got EOF from 127.0.0.1:59092 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:52:58.160389 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.159495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59094 (local address 127.19.29.253:43493)
0810 14:52:58.159536 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.159539 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.159800 (+ 261us) server_negotiation.cc:407] Connection header received
0810 14:52:58.159903 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.159904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.159917 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.159945 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.160330 (+ 385us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59094: BlockingRecv error: recv got EOF from 127.0.0.1:59094 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 14:52:58.194564 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.193729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59096 (local address 127.19.29.253:43493)
0810 14:52:58.193783 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.193785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.193930 (+ 145us) server_negotiation.cc:407] Connection header received
0810 14:52:58.194009 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.194010 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.194025 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.194078 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.194497 (+ 419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59096: BlockingRecv error: recv got EOF from 127.0.0.1:59096 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 14:52:58.260314 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.259615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59108 (local address 127.19.29.253:43493)
0810 14:52:58.259687 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.259689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.259763 (+ 74us) server_negotiation.cc:407] Connection header received
0810 14:52:58.259833 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.259833 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.259845 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.259896 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.260231 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59108: BlockingRecv error: recv got EOF from 127.0.0.1:59108 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
W20260810 14:52:58.389971 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.389360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.19.29.253:43493)
0810 14:52:58.389426 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.389428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.389512 (+ 84us) server_negotiation.cc:407] Connection header received
0810 14:52:58.389566 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.389567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.389578 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.389638 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.389922 (+ 284us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59110: BlockingRecv error: recv got EOF from 127.0.0.1:59110 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 14:52:58.647730 24626 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:52:58.647191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59124 (local address 127.19.29.253:43493)
0810 14:52:58.647247 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:58.647249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:58.647257 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:52:58.647316 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:58.647317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:58.647327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:58.647377 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:52:58.647668 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59124: BlockingRecv error: recv got EOF from 127.0.0.1:59124 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260810 14:52:59.004366 24781 catalog_manager.cc:1259] Loaded cluster ID: 837b0f79bef74e679e6ab97cdc4bf387
I20260810 14:52:59.004448 24781 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: loading cluster ID for follower catalog manager: success
I20260810 14:52:59.005275 24781 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: acquiring CA information for follower catalog manager: success
I20260810 14:52:59.005577 24781 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 97745ef5c732479e8583135a4349962f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:52:59.082343 24847 catalog_manager.cc:1259] Loaded cluster ID: 837b0f79bef74e679e6ab97cdc4bf387
I20260810 14:52:59.082422 24847 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: loading cluster ID for follower catalog manager: success
I20260810 14:52:59.083241 24847 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: acquiring CA information for follower catalog manager: success
I20260810 14:52:59.083544 24847 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8b123e9b3a1f4b57a1a357bfe2a9799e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:52:59.163282 24965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:59.160784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59128 (local address 127.19.29.253:43493)
0810 14:52:59.160893 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:59.160895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:59.160905 (+ 10us) server_negotiation.cc:407] Connection header received
0810 14:52:59.160972 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:59.160973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:59.161028 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:59.161093 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:59.161282 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.161808 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.162617 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.162819 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.162883 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:59.163006 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:59.163115 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:59.163170 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:59.163185 (+ 15us) server_negotiation.cc:299] Negotiation successful
0810 14:52:59.163203 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":60,"threads_started":1}
I20260810 14:52:59.174773 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:59.165105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41260 (local address 127.19.29.252:39163)
0810 14:52:59.165242 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:59.165244 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:59.172440 (+ 7196us) server_negotiation.cc:407] Connection header received
0810 14:52:59.172497 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:59.172498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:59.172546 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:59.172617 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:59.172728 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.173224 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.173957 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.174177 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.174231 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:59.174448 (+ 217us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:59.174586 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:59.174650 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:59.174690 (+ 40us) server_negotiation.cc:299] Negotiation successful
0810 14:52:59.174707 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":76,"threads_started":1}
I20260810 14:52:59.178725 24965 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:59.176309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59130 (local address 127.19.29.253:43493)
0810 14:52:59.176398 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:59.176399 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:59.176410 (+ 11us) server_negotiation.cc:407] Connection header received
0810 14:52:59.176487 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:59.176488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:59.176501 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:59.176556 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:59.176693 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.177229 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.178033 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.178265 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.178356 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:59.178482 (+ 126us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:59.178514 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:59.178562 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:59.178631 (+ 69us) server_negotiation.cc:299] Negotiation successful
0810 14:52:59.178652 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260810 14:52:59.179440 24988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:59.176292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.19.29.254:37055)
0810 14:52:59.176407 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:59.176409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:59.176538 (+ 129us) server_negotiation.cc:407] Connection header received
0810 14:52:59.176587 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:59.176588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:59.176637 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:59.176721 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:59.176876 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.177638 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.178515 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.178836 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.178890 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:59.179105 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:59.179236 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:59.179287 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:59.179339 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 14:52:59.179361 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":64,"threads_started":1}
I20260810 14:52:59.180235 24974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:52:59.176597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41266 (local address 127.19.29.252:39163)
0810 14:52:59.176634 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:52:59.176635 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:52:59.176716 (+ 81us) server_negotiation.cc:407] Connection header received
0810 14:52:59.176768 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:52:59.176768 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:52:59.176779 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:52:59.176828 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:52:59.176952 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.177649 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.179380 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:52:59.179634 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:52:59.179690 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:52:59.179826 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:52:59.179856 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:52:59.179899 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0810 14:52:59.180093 (+ 194us) server_negotiation.cc:299] Negotiation successful
0810 14:52:59.180113 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:52:59.181152 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24374
I20260810 14:52:59.192762 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24512
I20260810 14:52:59.206210 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 24632
2026-08-10T14:52:59Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2922 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 10 14:52:59 dist-test-slave-4tdj krb5kdc[24994](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 10 14:52:59 dist-test-slave-4tdj krb5kdc[24994](info): set up 2 sockets
Aug 10 14:52:59 dist-test-slave-4tdj krb5kdc[24994](info): commencing operation
krb5kdc: starting...
W20260810 14:53:00.361735 19575 mini_kdc.cc:121] Time spent starting KDC: real 1.133s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/test-user.keytab.
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-10T14:53:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-10T14:53:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.19.29.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
Entry for principal kudu/127.19.29.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab.
I20260810 14:53:00.476521 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45655
--webserver_interface=127.19.29.254
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260810 14:53:00.556829 25013 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:53:00.557035 25013 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:53:00.557052 25013 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:53:00.557070 25013 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:53:00.558166 25013 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:53:00.558200 25013 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:53:00.558213 25013 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:53:00.558223 25013 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:53:00.558234 25013 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:53:00.559742 25013 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.254.keytab
--principal=kudu/127.19.29.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.254:45655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.19.29.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25013
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:53:00.559944 25013 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:53:00.560122 25013 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:53:00.564822 25024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:53:00.564833 25022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:53:00.564870 25013 server_base.cc:1034] running on GCE node
W20260810 14:53:00.564836 25021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:53:00.565292 25013 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:53:00.565558 25013 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:53:00.566692 25013 hybrid_clock.cc:648] HybridClock initialized: now 1786373580566682 us; error 30 us; skew 500 ppm
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:53:00.572031 25013 init.cc:377] Logged in from keytab as kudu/127.19.29.254@KRBTEST.COM (short username kudu)
I20260810 14:53:00.572427 25013 webserver.cc:460] Webserver started at http://127.19.29.254:33231/ using document root <none> and password file <none>
I20260810 14:53:00.572608 25013 fs_manager.cc:359] Metadata directory not provided
I20260810 14:53:00.572647 25013 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:53:00.572744 25013 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:53:00.573756 25013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data/instance:
uuid: "b6125e1529a74e8eae5f50d118d96a33"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "765ab53c8dded51838341c2dcd6e2ab9"
server_key_iv: "13d5d412d35bbe60b33704ef20142fdb"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.574043 25013 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance:
uuid: "b6125e1529a74e8eae5f50d118d96a33"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "765ab53c8dded51838341c2dcd6e2ab9"
server_key_iv: "13d5d412d35bbe60b33704ef20142fdb"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.575351 25013 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260810 14:53:00.576063 25037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:53:00.576207 25013 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260810 14:53:00.576290 25013 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal
uuid: "b6125e1529a74e8eae5f50d118d96a33"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "765ab53c8dded51838341c2dcd6e2ab9"
server_key_iv: "13d5d412d35bbe60b33704ef20142fdb"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.576357 25013 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:53:00.587805 25013 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:53:00.589614 25013 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:53:00.589733 25013 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:53:00.593621 25013 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.254:45655
I20260810 14:53:00.593667 25116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.254:45655 every 8 connection(s)
I20260810 14:53:00.593973 25013 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/data/info.pb
I20260810 14:53:00.594975 25117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:53:00.596474 25117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.600760 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25013
I20260810 14:53:00.600855 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-0/wal/instance
I20260810 14:53:00.601013 19575 external_mini_cluster.cc:1428] Setting key 5c709f16a7f4ff32121e3607e7440093
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:53:00.605885 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.597079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45655 (local address 127.0.0.1:53640)
0810 14:53:00.597261 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.597301 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.597770 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.598019 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.598021 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.598286 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.598471 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.598476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.599456 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.599457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.600103 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.600105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.600555 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.600556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.600644 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.601127 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.601137 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.602681 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.604513 (+ 1832us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.604520 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.604522 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.604704 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.604944 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.604944 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.604945 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.605021 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.605435 (+ 414us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.605438 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.605491 (+ 53us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.605563 (+ 72us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.605726 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260810 14:53:00.605917 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.597138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53640 (local address 127.19.29.254:45655)
0810 14:53:00.597271 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.597280 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.597391 (+ 111us) server_negotiation.cc:407] Connection header received
0810 14:53:00.597915 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.597918 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.597935 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.598007 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.598564 (+ 557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.599358 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.600176 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.600467 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.600575 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.602770 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.602780 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.602781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.602789 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.604422 (+ 1633us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.604781 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.604785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.604785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.604885 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.605071 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.605072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.605073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.605369 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.605463 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.605622 (+ 159us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.605817 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":93,"server-negotiator.queue_time_us":97,"thread_start_us":63,"threads_started":1}
I20260810 14:53:00.606621 25117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.606933 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.606834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36020)
0810 14:53:00.606873 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.606915 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260810 14:53:00.607070 25038 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
I20260810 14:53:00.607434 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.607371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36030)
0810 14:53:00.607395 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.607418 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260810 14:53:00.607529 25117 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:44561: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.19.29.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
Entry for principal kudu/127.19.29.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab.
I20260810 14:53:00.627005 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:44561
--webserver_interface=127.19.29.253
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:53:00.656796 25117 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } attempt: 1
I20260810 14:53:00.657359 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.657198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36038)
0810 14:53:00.657268 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.657322 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260810 14:53:00.657677 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.657594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36050)
0810 14:53:00.657632 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.657658 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:53:00.657771 25117 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:44561: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
W20260810 14:53:00.709043 25128 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:53:00.709257 25128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:53:00.709275 25128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:53:00.709295 25128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:53:00.710451 25128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:53:00.710489 25128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:53:00.710503 25128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:53:00.710526 25128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:53:00.710549 25128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:53:00.712040 25128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.253.keytab
--principal=kudu/127.19.29.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.253:44561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.19.29.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:53:00.712266 25128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:53:00.712460 25128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260810 14:53:00.717137 25134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:53:00.717252 25133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:53:00.717181 25137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:53:00.717304 25128 server_base.cc:1034] running on GCE node
I20260810 14:53:00.717628 25128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:53:00.717907 25128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:53:00.719043 25128 hybrid_clock.cc:648] HybridClock initialized: now 1786373580719032 us; error 48 us; skew 500 ppm
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:53:00.721390 25128 init.cc:377] Logged in from keytab as kudu/127.19.29.253@KRBTEST.COM (short username kudu)
I20260810 14:53:00.721829 25128 webserver.cc:460] Webserver started at http://127.19.29.253:34749/ using document root <none> and password file <none>
I20260810 14:53:00.722036 25128 fs_manager.cc:359] Metadata directory not provided
I20260810 14:53:00.722083 25128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:53:00.722218 25128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:53:00.723289 25128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data/instance:
uuid: "69f176f2d8714d63ae0c04102e53b33b"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "f90ec153c1b34191a72f16e1b895072e"
server_key_iv: "24ccb75114fa6fc8acfd3a091b02a428"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.723615 25128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal/instance:
uuid: "69f176f2d8714d63ae0c04102e53b33b"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "f90ec153c1b34191a72f16e1b895072e"
server_key_iv: "24ccb75114fa6fc8acfd3a091b02a428"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.724875 25128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260810 14:53:00.725559 25153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:53:00.725715 25128 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:53:00.725801 25128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal
uuid: "69f176f2d8714d63ae0c04102e53b33b"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "f90ec153c1b34191a72f16e1b895072e"
server_key_iv: "24ccb75114fa6fc8acfd3a091b02a428"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.725867 25128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:53:00.725924 25117 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } attempt: 2
I20260810 14:53:00.726334 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.726206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36062)
0810 14:53:00.726254 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.726304 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260810 14:53:00.726686 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.726572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36064)
0810 14:53:00.726634 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.726661 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260810 14:53:00.726770 25117 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.253:44561: Network error: Client connection negotiation failed: client connection to 127.19.29.253:44561: connect: Connection refused (error 111)
I20260810 14:53:00.734938 25128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:53:00.736636 25128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:53:00.736768 25128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:53:00.740777 25128 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.253:44561
I20260810 14:53:00.740818 25231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.253:44561 every 8 connection(s)
I20260810 14:53:00.741140 25128 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/data/info.pb
I20260810 14:53:00.742039 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25128
I20260810 14:53:00.742125 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-1/wal/instance
I20260810 14:53:00.742194 25233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:53:00.742329 19575 external_mini_cluster.cc:1428] Setting key d324eb79eb996bbb8d053ccb92bf2d04
I20260810 14:53:00.743841 25233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.19.29.252@KRBTEST.COM; defaulting to no policy
I20260810 14:53:00.752641 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.744547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53646 (local address 127.19.29.254:45655)
0810 14:53:00.744598 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.744600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.744824 (+ 224us) server_negotiation.cc:407] Connection header received
0810 14:53:00.745339 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.745341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.745357 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.745418 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.746027 (+ 609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.746796 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.747804 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.748123 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.748202 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.750287 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.750320 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.750320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.750328 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.751530 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.751907 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.751908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.751908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.751960 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.752133 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.752133 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.752134 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.752242 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.752287 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.752488 (+ 201us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.752550 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260810 14:53:00.752779 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.744535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45655 (local address 127.0.0.1:53646)
0810 14:53:00.744707 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.744743 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.745225 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.745496 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.745500 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.745734 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.745931 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.745935 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.746899 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.746900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.747717 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.747720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.748236 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.748237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.748395 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.748859 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.748867 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.750192 (+ 1325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.751638 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.751646 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.751648 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.751848 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.752008 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.752008 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.752008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.752093 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.752284 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.752287 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.752402 (+ 115us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.752478 (+ 76us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.752592 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":90,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.19.29.252@KRBTEST.COM" created.
I20260810 14:53:00.753341 25233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } has no permanent_uuid. Determining permanent_uuid...
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:53:00.761070 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.753584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36080)
0810 14:53:00.753739 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.753750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.753794 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.754547 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.754548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.754664 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.754714 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.754715 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.755668 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.755669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.756370 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.756372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.756882 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.756883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.756960 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.757312 (+ 352us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.757318 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.758626 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.760138 (+ 1512us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.760139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.760139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.760290 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.760460 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.760461 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.760461 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.760514 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.760767 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.760768 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.760806 (+ 38us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.760865 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.760964 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260810 14:53:00.761237 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.753633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36080 (local address 127.19.29.253:44561)
0810 14:53:00.754400 (+ 767us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.754404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.754429 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:53:00.754451 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.754453 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.754467 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.754543 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.754778 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.755580 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.756460 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.756803 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.756866 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.758699 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.758708 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.758709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.758715 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.760064 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.760357 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.760360 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.760360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.760407 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.760563 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.760564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.760564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.760695 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.760766 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.760902 (+ 136us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.761043 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":728,"thread_start_us":106,"threads_started":1}
I20260810 14:53:00.762012 25233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.763250 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.763130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55738)
0810 14:53:00.763181 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.763227 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260810 14:53:00.763386 25157 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
I20260810 14:53:00.763814 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.763734 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55746)
0810 14:53:00.763773 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.763796 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260810 14:53:00.763931 25233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:43087: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
Entry for principal kudu/127.19.29.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab.
I20260810 14:53:00.768512 19575 external_mini_cluster.cc:1326] Running /tmp/dist-test-tasko2eqSt/build/release/bin/kudu
/tmp/dist-test-tasko2eqSt/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:43087
--webserver_interface=127.19.29.252
--webserver_port=0
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.19.29.212:32843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260810 14:53:00.813151 25233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } attempt: 1
I20260810 14:53:00.813764 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.813618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55752)
0810 14:53:00.813680 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.813730 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260810 14:53:00.814169 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.814059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55762)
0810 14:53:00.814112 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.814143 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260810 14:53:00.814282 25233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:43087: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
I20260810 14:53:00.817919 25117 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } attempt: 3
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:53:00.824982 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.818340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36096 (local address 127.19.29.253:44561)
0810 14:53:00.818392 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.818394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.818407 (+ 13us) server_negotiation.cc:407] Connection header received
0810 14:53:00.818474 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.818475 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.818485 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.818532 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.818887 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.819373 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.820385 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.820605 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.820660 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.822628 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.822630 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.822630 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.822638 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.823921 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.824273 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.824274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.824274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.824322 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.824527 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.824529 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.824529 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.824649 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.824719 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.824860 (+ 141us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.824923 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:53:00.825028 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.818262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36096)
0810 14:53:00.818338 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.818350 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.818410 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.818558 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.818558 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.818748 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.818827 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.818829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.819441 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.819442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.820296 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.820299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.820676 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.820677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.820755 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.821157 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.821162 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.822548 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.823999 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.824000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.824001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.824208 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.824376 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.824377 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.824377 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.824440 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.824722 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.824723 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.824771 (+ 48us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.824839 (+ 68us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.824936 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260810 14:53:00.825409 25117 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.825735 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.825635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55778)
0810 14:53:00.825680 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.825711 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:53:00.825976 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.825918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55784)
0810 14:53:00.825940 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.825961 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260810 14:53:00.826063 25117 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:43087: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
W20260810 14:53:00.851394 25244 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260810 14:53:00.851598 25244 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260810 14:53:00.851613 25244 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260810 14:53:00.851635 25244 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260810 14:53:00.852761 25244 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260810 14:53:00.852800 25244 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260810 14:53:00.852813 25244 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260810 14:53:00.852825 25244 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260810 14:53:00.852849 25244 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260810 14:53:00.854357 25244 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.19.29.212:32843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.19.29.254:45655,127.19.29.253:44561,127.19.29.252:43087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/krb5kdc/kudu_127.19.29.252.keytab
--principal=kudu/127.19.29.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.19.29.252:43087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.19.29.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 10 Aug 2026 13:36:56 UTC on ccycloud.quasar-zxzunu.root.comops.site
build id 4577778
I20260810 14:53:00.854593 25244 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260810 14:53:00.854806 25244 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260810 14:53:00.857213 25117 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } attempt: 1
I20260810 14:53:00.857663 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.857494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55786)
0810 14:53:00.857582 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.857630 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260810 14:53:00.858071 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.857973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55796)
0810 14:53:00.858020 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.858048 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260810 14:53:00.858175 25117 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:43087: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
W20260810 14:53:00.859642 25249 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:53:00.859649 25250 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260810 14:53:00.859702 25252 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260810 14:53:00.859884 25244 server_base.cc:1034] running on GCE node
I20260810 14:53:00.860144 25244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260810 14:53:00.860419 25244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260810 14:53:00.861590 25244 hybrid_clock.cc:648] HybridClock initialized: now 1786373580861565 us; error 34 us; skew 500 ppm
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260810 14:53:00.863951 25244 init.cc:377] Logged in from keytab as kudu/127.19.29.252@KRBTEST.COM (short username kudu)
I20260810 14:53:00.864387 25244 webserver.cc:460] Webserver started at http://127.19.29.252:45777/ using document root <none> and password file <none>
I20260810 14:53:00.864581 25244 fs_manager.cc:359] Metadata directory not provided
I20260810 14:53:00.864627 25244 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260810 14:53:00.864751 25244 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260810 14:53:00.865753 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data/instance:
uuid: "3fad084163394f089c3b3ee487583ba1"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "fc7c83e1f251efc9cf13b88d125533d6"
server_key_iv: "2c0e27eb61518703534344bd36b33e02"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.866081 25244 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal/instance:
uuid: "3fad084163394f089c3b3ee487583ba1"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "fc7c83e1f251efc9cf13b88d125533d6"
server_key_iv: "2c0e27eb61518703534344bd36b33e02"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.867342 25244 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260810 14:53:00.867977 25260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260810 14:53:00.868126 25244 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260810 14:53:00.868209 25244 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data,/tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal
uuid: "3fad084163394f089c3b3ee487583ba1"
format_stamp: "Formatted at 2026-08-10 14:53:00 on dist-test-slave-4tdj"
server_key: "fc7c83e1f251efc9cf13b88d125533d6"
server_key_iv: "2c0e27eb61518703534344bd36b33e02"
server_key_version: "encryptionkey@0"
I20260810 14:53:00.868274 25244 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260810 14:53:00.882436 25233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } attempt: 2
I20260810 14:53:00.882791 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.882685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55804)
0810 14:53:00.882734 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.882762 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260810 14:53:00.883114 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.883028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55816)
0810 14:53:00.883068 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.883092 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260810 14:53:00.883200 25233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.19.29.252:43087: Network error: Client connection negotiation failed: client connection to 127.19.29.252:43087: connect: Connection refused (error 111)
I20260810 14:53:00.891228 25244 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260810 14:53:00.893006 25244 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260810 14:53:00.893150 25244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260810 14:53:00.897212 25244 rpc_server.cc:307] RPC server started. Bound to: 127.19.29.252:43087
I20260810 14:53:00.897239 25340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.19.29.252:43087 every 8 connection(s)
I20260810 14:53:00.897578 25244 server_base.cc:1166] Dumped server information to /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/data/info.pb
I20260810 14:53:00.898547 25343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260810 14:53:00.900053 25343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.903674 19575 external_mini_cluster.cc:1388] Started /tmp/dist-test-tasko2eqSt/build/release/bin/kudu as pid 25244
I20260810 14:53:00.903790 19575 external_mini_cluster.cc:1402] Reading /tmp/dist-test-tasko2eqSt/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786373310130398-19575-0/minicluster-data/master-2/wal/instance
I20260810 14:53:00.903956 19575 external_mini_cluster.cc:1428] Setting key d656a9cbd87bc5e3e53992a7387f19fc
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:53:00.908509 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.900711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53658 (local address 127.19.29.254:45655)
0810 14:53:00.900763 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.900765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.900955 (+ 190us) server_negotiation.cc:407] Connection header received
0810 14:53:00.901398 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.901399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.901407 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.901457 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.902001 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.902521 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.903446 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.903715 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.903795 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.906035 (+ 2240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.906037 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.906037 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.906045 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.907310 (+ 1265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.907664 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.907667 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.907667 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.907719 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.907929 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.907930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.907931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.908035 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.908088 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.908341 (+ 253us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.908422 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260810 14:53:00.908646 25349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.900670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.254:45655 (local address 127.0.0.1:53658)
0810 14:53:00.900834 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.900885 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.901325 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.901517 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.901520 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.901754 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.901936 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.901940 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.902599 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.902600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.903385 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.903387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.903836 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.903838 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.903985 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.904542 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.904550 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.905953 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.907385 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.907392 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.907394 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.907599 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.907773 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.907774 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.907774 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.907875 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.908090 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.908097 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.908225 (+ 128us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.908310 (+ 85us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.908446 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:53:00.909204 25343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.911960 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.904309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55820 (local address 127.19.29.252:43087)
0810 14:53:00.904512 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.904517 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.904540 (+ 23us) server_negotiation.cc:407] Connection header received
0810 14:53:00.904572 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.904574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.904612 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.904680 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.905363 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.906086 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.906839 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.907140 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.907197 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.909286 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.909292 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.909292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.909299 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.910951 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.911278 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.911281 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.911281 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.911334 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.911494 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.911494 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.911494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.911626 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.911757 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.911808 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.911873 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:53:00.915577 25349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.909410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.253:44561 (local address 127.0.0.1:36104)
0810 14:53:00.909456 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.909466 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.909504 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.909607 (+ 103us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.909608 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.909728 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.909775 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.909777 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.910503 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.910504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.911176 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.911178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.911600 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.911601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.911668 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.912017 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.912022 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.913164 (+ 1142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.914707 (+ 1543us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.914708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.914708 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.914860 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.915033 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.915034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.915035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.915090 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.915311 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.915311 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.915351 (+ 40us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.915410 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.915492 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:53:00.915591 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.909475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36104 (local address 127.19.29.253:44561)
0810 14:53:00.909515 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.909517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.909525 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:00.909551 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.909552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.909561 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.909602 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.909844 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.910439 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.911257 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.911536 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.911587 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.913235 (+ 1648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.913236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.913236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.913244 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.914630 (+ 1386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.914919 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.914920 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.914921 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.914978 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.915141 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.915141 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.915142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.915258 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.915312 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.915440 (+ 128us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.915509 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.254@KRBTEST.COM
I20260810 14:53:00.916177 25343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } has no permanent_uuid. Determining permanent_uuid...
I20260810 14:53:00.918776 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.912676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53674 (local address 127.19.29.254:45655)
0810 14:53:00.912707 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.912709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.912717 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:00.912780 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.912781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.912788 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.912820 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.913257 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.913688 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.914317 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.914516 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.914568 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.916439 (+ 1871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.916440 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.916441 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.916448 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.917747 (+ 1299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.918075 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.918076 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.918076 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.918116 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.918278 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.918278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.918279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.918415 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.918572 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.918642 (+ 70us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.918702 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.252@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:53:00.922469 25349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.916388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55822)
0810 14:53:00.916441 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.916450 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.916480 (+ 30us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.916578 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.916578 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.916711 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.916740 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.916742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.917547 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.917548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.918146 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.918149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.918585 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.918586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.918638 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.918969 (+ 331us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.918974 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.920040 (+ 1066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.921517 (+ 1477us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.921518 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.921518 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.921668 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.921847 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.921848 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.921848 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.921890 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.922133 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.922134 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.922171 (+ 37us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.922236 (+ 65us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.922340 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260810 14:53:00.922523 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.916446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55822 (local address 127.19.29.252:43087)
0810 14:53:00.916487 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.916489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.916498 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:53:00.916529 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.916529 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.916537 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.916573 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.916815 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.917477 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.918216 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.918512 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.918565 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.920107 (+ 1542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.920108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.920108 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.920114 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.921432 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.921730 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.921731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.921731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.921790 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.921956 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.921957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.921957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.922075 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.922137 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.922267 (+ 130us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.922391 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":14,"server-negotiator.queue_time_us":25}
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.19.29.253@KRBTEST.COM
I20260810 14:53:00.924124 25343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: Bootstrap starting.
I20260810 14:53:00.924935 25343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: Neither blocks nor log segments found. Creating new log.
I20260810 14:53:00.925221 25343 log.cc:824] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: Log is configured to *not* fsync() on all Append() calls
I20260810 14:53:00.926034 25343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: No bootstrap required, opened a new log
I20260810 14:53:00.926497 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.919492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36120 (local address 127.19.29.253:44561)
0810 14:53:00.919539 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.919541 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.919547 (+ 6us) server_negotiation.cc:407] Connection header received
0810 14:53:00.919564 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.919565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.919573 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.919617 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.920069 (+ 452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.920719 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.921576 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.921839 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.921889 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.924186 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.924188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.924188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.924195 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.925512 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.925828 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.925829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.925829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.925876 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.926054 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.926054 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.926054 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.926147 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.926274 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.926383 (+ 109us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.926439 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260810 14:53:00.927819 19575 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260810 14:53:00.927892 25343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.928038 25343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fad084163394f089c3b3ee487583ba1, State: Initialized, Role: FOLLOWER
I20260810 14:53:00.928138 25343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.928407 25353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.928475 25343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:53:00.928498 25353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:00.928911 25078 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b6125e1529a74e8eae5f50d118d96a33"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53674
W20260810 14:53:00.930253 25376 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260810 14:53:00.930346 25376 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260810 14:53:00.930650 25244 master_runner.cc:186] Error getting master registration for 127.19.29.254:45655: OK, instance_id { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" instance_seqno: 1786373580592602 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:53:00.933298 25117 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } attempt: 2
I20260810 14:53:00.933380 25244 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.254@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:53:00.939465 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.933525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55834)
0810 14:53:00.933571 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.933580 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.933616 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.933746 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.933747 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.933878 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.933913 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.933915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.934540 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.934541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.935029 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.935030 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.935360 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.935362 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.935416 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.935792 (+ 376us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.935796 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.936844 (+ 1048us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.938549 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.938550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.938551 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.938708 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.938890 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.938890 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.938890 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.938930 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.939185 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.939186 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.939243 (+ 57us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.939298 (+ 55us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.939385 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260810 14:53:00.939491 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.933561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55834 (local address 127.19.29.252:43087)
0810 14:53:00.933600 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.933602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.933610 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:00.933673 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.933673 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.933684 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.933728 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.933973 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.934473 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.935095 (+ 622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.935304 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.935355 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.936940 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.936941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.936942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.936950 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.938472 (+ 1522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.938766 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.938767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.938768 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.938825 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.938964 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.938965 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.938965 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.939126 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.939196 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.939330 (+ 134us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.939406 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:53:00.941215 25117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33: Bootstrap starting.
I20260810 14:53:00.941949 25117 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33: Neither blocks nor log segments found. Creating new log.
I20260810 14:53:00.942260 25117 log.cc:824] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33: Log is configured to *not* fsync() on all Append() calls
I20260810 14:53:00.943125 25117 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33: No bootstrap required, opened a new log
I20260810 14:53:00.944463 25117 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.944603 25117 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6125e1529a74e8eae5f50d118d96a33, State: Initialized, Role: FOLLOWER
I20260810 14:53:00.944684 25117 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.944993 25117 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:53:00.944949 25382 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.945029 25078 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260810 14:53:00.945060 25382 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:00.945241 25078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:53:00.945960 25078 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.946533 25305 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6125e1529a74e8eae5f50d118d96a33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "3fad084163394f089c3b3ee487583ba1"
I20260810 14:53:00.946661 25305 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:53:00.946556 25078 leader_election.cc:288] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [CANDIDATE]: Term 1 election: Requested vote from peers 69f176f2d8714d63ae0c04102e53b33b (127.19.29.253:44561), 3fad084163394f089c3b3ee487583ba1 (127.19.29.252:43087)
I20260810 14:53:00.947515 25305 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6125e1529a74e8eae5f50d118d96a33 in term 1.
I20260810 14:53:00.947805 25040 leader_election.cc:302] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fad084163394f089c3b3ee487583ba1, b6125e1529a74e8eae5f50d118d96a33; no voters:
I20260810 14:53:00.947805 25013 master_runner.cc:186] Error getting master registration for 127.19.29.253:44561: OK, instance_id { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" instance_seqno: 1786373580739681 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260810 14:53:00.950278 25013 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260810 14:53:00.950368 25382 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 1 FOLLOWER]: Leader election won for term 1
I20260810 14:53:00.950488 25382 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [term 1 LEADER]: Becoming Leader. State: Replica: b6125e1529a74e8eae5f50d118d96a33, State: Running, Role: LEADER
I20260810 14:53:00.950570 25382 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.951895 25409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6125e1529a74e8eae5f50d118d96a33. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.951993 25409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: This master's current role is: LEADER
I20260810 14:53:00.953155 25412 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260810 14:53:00.953639 25412 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260810 14:53:00.956930 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.948015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36128 (local address 127.19.29.253:44561)
0810 14:53:00.948060 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.948062 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.948306 (+ 244us) server_negotiation.cc:407] Connection header received
0810 14:53:00.948357 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.948358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.948370 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.948438 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.949129 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.949839 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.950879 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.951591 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.951668 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.953117 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.953119 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.953119 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.953126 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.954682 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.955234 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.955235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.955236 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.955295 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.955477 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.955479 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.955479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.955605 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.955703 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.956757 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.956838 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:53:00.962769 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.954861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55842 (local address 127.19.29.252:43087)
0810 14:53:00.954902 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.954903 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.956057 (+ 1154us) server_negotiation.cc:407] Connection header received
0810 14:53:00.956080 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.956081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.956091 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.956133 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.956704 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.957331 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.958240 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.958579 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.958637 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.959926 (+ 1289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.959928 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.959928 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.959935 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.961479 (+ 1544us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.961838 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.961839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.961839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.961890 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.962072 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.962073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.962073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.962191 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.962286 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.962607 (+ 321us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.962679 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260810 14:53:00.966207 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.954838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53686 (local address 127.19.29.254:45655)
0810 14:53:00.954886 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.954888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.954896 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:00.954915 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.954916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.954925 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.954979 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.955543 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.956185 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.959691 (+ 3506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.959992 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.960033 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.962527 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.962529 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.962529 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.962536 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.964537 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.965112 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.965113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.965113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.965190 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.965510 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.965511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.965511 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.965651 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.965716 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.966032 (+ 316us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.966110 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260810 14:53:00.967368 25305 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [term 1 FOLLOWER]: Refusing update from remote peer b6125e1529a74e8eae5f50d118d96a33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:53:00.967674 25409 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:53:00.969129 25353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6125e1529a74e8eae5f50d118d96a33. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.969231 25353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:00.974325 25233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } attempt: 3
Aug 10 14:53:00 dist-test-slave-4tdj krb5kdc[24994](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786373580, etypes {rep=17 tkt=17 ses=17}, kudu/127.19.29.253@KRBTEST.COM for kudu/127.19.29.252@KRBTEST.COM
I20260810 14:53:00.979359 25382 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.979447 25382 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: This master's current role is: LEADER
I20260810 14:53:00.979513 25414 mvcc.cc:205] Tried to move back new op lower bound from 7316986187639025664 to 7316986187574194176. Current Snapshot: MvccSnapshot[applied={T|T < 7316986187639025664}]
I20260810 14:53:00.979803 25353 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:00.979882 25353 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1 [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:00.980548 25419 mvcc.cc:205] Tried to move back new op lower bound from 7316986187639025664 to 7316986187574194176. Current Snapshot: MvccSnapshot[applied={T|T < 7316986187639025664 or (T in {7316986187639025664})}]
I20260810 14:53:00.982169 25412 catalog_manager.cc:1347] Generated new cluster ID: 62a927411eb3471d82593ed736191bed
I20260810 14:53:00.982215 25412 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260810 14:53:00.982372 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.974568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.19.29.252:43087 (local address 127.0.0.1:55846)
0810 14:53:00.974609 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0810 14:53:00.974620 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0810 14:53:00.974670 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0810 14:53:00.974786 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0810 14:53:00.974787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0810 14:53:00.974943 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0810 14:53:00.974988 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.974990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.975850 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.975850 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.976691 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0810 14:53:00.976694 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.977145 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.977146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0810 14:53:00.977227 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.977696 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0810 14:53:00.977702 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0810 14:53:00.979138 (+ 1436us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0810 14:53:00.981032 (+ 1894us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.981033 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.981034 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.981253 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.981688 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0810 14:53:00.981688 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0810 14:53:00.981689 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0810 14:53:00.981749 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0810 14:53:00.982047 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0810 14:53:00.982048 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0810 14:53:00.982092 (+ 44us) client_negotiation.cc:769] Sending connection context
0810 14:53:00.982151 (+ 59us) client_negotiation.cc:240] Negotiation successful
0810 14:53:00.982254 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260810 14:53:00.982872 25351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:00.974606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55846 (local address 127.19.29.252:43087)
0810 14:53:00.974661 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:00.974663 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:00.974671 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:00.974717 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:00.974718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:00.974727 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:00.974781 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:00.975058 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.975764 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.976771 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:00.977075 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:00.977140 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:00.979335 (+ 2195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0810 14:53:00.979337 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0810 14:53:00.979337 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0810 14:53:00.979344 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0810 14:53:00.980945 (+ 1601us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.981559 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.981560 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.981561 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.981615 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0810 14:53:00.981810 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0810 14:53:00.981811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0810 14:53:00.981811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0810 14:53:00.981959 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0810 14:53:00.982018 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:00.982707 (+ 689us) server_negotiation.cc:299] Negotiation successful
0810 14:53:00.982786 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260810 14:53:00.988794 25233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: Bootstrap starting.
I20260810 14:53:00.989522 25233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: Neither blocks nor log segments found. Creating new log.
I20260810 14:53:00.989805 25233 log.cc:824] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: Log is configured to *not* fsync() on all Append() calls
I20260810 14:53:00.994917 25233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: No bootstrap required, opened a new log
I20260810 14:53:00.996878 25233 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.996976 25412 catalog_manager.cc:1370] Generated new certificate authority record
I20260810 14:53:00.997002 25233 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69f176f2d8714d63ae0c04102e53b33b, State: Initialized, Role: FOLLOWER
I20260810 14:53:00.997074 25233 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } }
I20260810 14:53:00.997390 25233 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: configured and running, proceeding with master startup.
I20260810 14:53:00.997660 25412 catalog_manager.cc:1504] Loading token signing keys...
I20260810 14:53:00.999145 25194 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b6125e1529a74e8eae5f50d118d96a33" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "69f176f2d8714d63ae0c04102e53b33b"
I20260810 14:53:00.999270 25194 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [term 0 FOLLOWER]: Advancing to term 1
I20260810 14:53:01.000088 25194 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6125e1529a74e8eae5f50d118d96a33 in term 1.
I20260810 14:53:01.000422 25193 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [term 1 FOLLOWER]: Refusing update from remote peer b6125e1529a74e8eae5f50d118d96a33: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260810 14:53:01.000684 25409 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260810 14:53:01.001019 25412 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33: Generated new TSK 0
I20260810 14:53:01.001185 25412 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260810 14:53:01.002398 25427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:01.003127 25427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:01.003151 25461 catalog_manager.cc:1259] Loaded cluster ID: 62a927411eb3471d82593ed736191bed
I20260810 14:53:01.003189 25461 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: loading cluster ID for follower catalog manager: success
I20260810 14:53:01.004284 25461 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: acquiring CA information for follower catalog manager: success
I20260810 14:53:01.004582 25461 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:53:01.003192 25427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6125e1529a74e8eae5f50d118d96a33. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:01.004703 25427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: This master's current role is: FOLLOWER
I20260810 14:53:01.004739 25427 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:01.004771 25427 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69f176f2d8714d63ae0c04102e53b33b [sys.catalog]: This master's current role is: FOLLOWER
W20260810 14:53:01.036968 25239 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.035362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36144 (local address 127.19.29.253:44561)
0810 14:53:01.035408 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.035410 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.036317 (+ 907us) server_negotiation.cc:407] Connection header received
0810 14:53:01.036418 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.036419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.036430 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.036460 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.036885 (+ 425us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36144: BlockingRecv error: recv got EOF from 127.0.0.1:36144 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260810 14:53:01.037834 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.035603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55856 (local address 127.19.29.252:43087)
0810 14:53:01.035640 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.035642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.037363 (+ 1721us) server_negotiation.cc:407] Connection header received
0810 14:53:01.037453 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.037454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.037464 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.037490 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.037773 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55856: BlockingRecv error: recv got EOF from 127.0.0.1:55856 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 14:53:01.038668 25121 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.035789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53690 (local address 127.19.29.254:45655)
0810 14:53:01.035825 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.035826 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.038171 (+ 2345us) server_negotiation.cc:407] Connection header received
0810 14:53:01.038258 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.038259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.038268 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.038333 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.038611 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53690: BlockingRecv error: recv got EOF from 127.0.0.1:53690 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:53:01.044036 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.040165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36154 (local address 127.19.29.253:44561)
0810 14:53:01.040199 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.040201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.040425 (+ 224us) server_negotiation.cc:407] Connection header received
0810 14:53:01.040515 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.040516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.040553 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.040592 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.040767 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.041533 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.042694 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.043289 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.043335 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.043549 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.043671 (+ 122us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.043806 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.043948 (+ 142us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.043969 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:53:01.047475 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.046712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55870 (local address 127.19.29.252:43087)
0810 14:53:01.046748 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.046750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.046938 (+ 188us) server_negotiation.cc:407] Connection header received
0810 14:53:01.047045 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.047046 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.047077 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.047107 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.047429 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55870: BlockingRecv error: recv got EOF from 127.0.0.1:55870 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
I20260810 14:53:01.052827 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.049748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36158 (local address 127.19.29.253:44561)
0810 14:53:01.049781 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.049782 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.049986 (+ 204us) server_negotiation.cc:407] Connection header received
0810 14:53:01.050108 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.050110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.050119 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.050146 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.050355 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.051027 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.052091 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.052370 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.052406 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.052594 (+ 188us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.052627 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.052651 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.052744 (+ 93us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.052762 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
W20260810 14:53:01.055965 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.055233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55884 (local address 127.19.29.252:43087)
0810 14:53:01.055268 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.055270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.055455 (+ 185us) server_negotiation.cc:407] Connection header received
0810 14:53:01.055543 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.055544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.055555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.055583 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.055895 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55884: BlockingRecv error: recv got EOF from 127.0.0.1:55884 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:53:01.062456 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.059288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36170 (local address 127.19.29.253:44561)
0810 14:53:01.059320 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.059322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.059530 (+ 208us) server_negotiation.cc:407] Connection header received
0810 14:53:01.059626 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.059627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.059638 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.059663 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.059832 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.060528 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.061605 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.061889 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.061931 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.062146 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.062182 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.062210 (+ 28us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.062359 (+ 149us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.062381 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260810 14:53:01.066043 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.065158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55892 (local address 127.19.29.252:43087)
0810 14:53:01.065200 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.065202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.065475 (+ 273us) server_negotiation.cc:407] Connection header received
0810 14:53:01.065577 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.065578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.065590 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.065620 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.065988 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55892: BlockingRecv error: recv got EOF from 127.0.0.1:55892 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:53:01.074879 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.071561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36172 (local address 127.19.29.253:44561)
0810 14:53:01.071619 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.071621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.071872 (+ 251us) server_negotiation.cc:407] Connection header received
0810 14:53:01.071973 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.071974 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.071986 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.072013 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.072211 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.072932 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.074024 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.074364 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.074413 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.074617 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.074654 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.074679 (+ 25us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.074780 (+ 101us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.074800 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260810 14:53:01.078474 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.077465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55902 (local address 127.19.29.252:43087)
0810 14:53:01.077505 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.077507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.077690 (+ 183us) server_negotiation.cc:407] Connection header received
0810 14:53:01.077783 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.077784 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.077795 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.077824 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.078415 (+ 591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55902: BlockingRecv error: recv got EOF from 127.0.0.1:55902 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:53:01.091089 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.087857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36188 (local address 127.19.29.253:44561)
0810 14:53:01.087897 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.087899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.088133 (+ 234us) server_negotiation.cc:407] Connection header received
0810 14:53:01.088229 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.088230 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.088241 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.088270 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.088439 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.089169 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.090246 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.090585 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.090628 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.090822 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.090858 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.090882 (+ 24us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.090976 (+ 94us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.090996 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 14:53:01.094425 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.093564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.19.29.252:43087)
0810 14:53:01.093607 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.093609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.093831 (+ 222us) server_negotiation.cc:407] Connection header received
0810 14:53:01.093923 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.093924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.093935 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.093963 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.094371 (+ 408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55916: BlockingRecv error: recv got EOF from 127.0.0.1:55916 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
I20260810 14:53:01.115007 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.111913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36200 (local address 127.19.29.253:44561)
0810 14:53:01.111958 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.111960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.112148 (+ 188us) server_negotiation.cc:407] Connection header received
0810 14:53:01.112189 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.112191 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.112204 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.112275 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.112400 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.113140 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.114180 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.114509 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.114607 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.114754 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.114792 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.114847 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.114900 (+ 53us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.114920 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260810 14:53:01.117695 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.116914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55920 (local address 127.19.29.252:43087)
0810 14:53:01.116957 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.116959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.117170 (+ 211us) server_negotiation.cc:407] Connection header received
0810 14:53:01.117235 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.117236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.117250 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.117300 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.117633 (+ 333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55920: BlockingRecv error: recv got EOF from 127.0.0.1:55920 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:53:01.153451 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.150876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36206 (local address 127.19.29.253:44561)
0810 14:53:01.150928 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.150930 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.151070 (+ 140us) server_negotiation.cc:407] Connection header received
0810 14:53:01.151140 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.151141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.151151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.151199 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.151318 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.151798 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.152874 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.153062 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.153116 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.153248 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.153276 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.153309 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.153369 (+ 60us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.153385 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
W20260810 14:53:01.155805 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.155240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55934 (local address 127.19.29.252:43087)
0810 14:53:01.155290 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.155291 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.155316 (+ 25us) server_negotiation.cc:407] Connection header received
0810 14:53:01.155387 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.155388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.155397 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.155441 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.155753 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55934: BlockingRecv error: recv got EOF from 127.0.0.1:55934 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
I20260810 14:53:01.223291 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.220924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36222 (local address 127.19.29.253:44561)
0810 14:53:01.221011 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.221013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.221083 (+ 70us) server_negotiation.cc:407] Connection header received
0810 14:53:01.221159 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.221161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.221172 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.221220 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.221341 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.221831 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.222689 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.222879 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.222934 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.223070 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.223103 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.223143 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.223192 (+ 49us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.223213 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
W20260810 14:53:01.225354 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.224852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55946 (local address 127.19.29.252:43087)
0810 14:53:01.224903 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.224905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.224948 (+ 43us) server_negotiation.cc:407] Connection header received
0810 14:53:01.225002 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.225003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.225012 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.225056 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.225308 (+ 252us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55946: BlockingRecv error: recv got EOF from 127.0.0.1:55946 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:53:01.356748 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.354480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36230 (local address 127.19.29.253:44561)
0810 14:53:01.354545 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.354548 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.354627 (+ 79us) server_negotiation.cc:407] Connection header received
0810 14:53:01.354706 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.354707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.354718 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.354762 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.354879 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.355377 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.356138 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.356329 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.356384 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.356520 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.356556 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.356597 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.356649 (+ 52us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.356668 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260810 14:53:01.358745 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.358233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55962 (local address 127.19.29.252:43087)
0810 14:53:01.358304 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.358305 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.358342 (+ 37us) server_negotiation.cc:407] Connection header received
0810 14:53:01.358388 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.358389 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.358399 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.358441 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.358704 (+ 263us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55962: BlockingRecv error: recv got EOF from 127.0.0.1:55962 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
I20260810 14:53:01.478056 25409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b6125e1529a74e8eae5f50d118d96a33" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6125e1529a74e8eae5f50d118d96a33" member_type: VOTER last_known_addr { host: "127.19.29.254" port: 45655 } } peers { permanent_uuid: "69f176f2d8714d63ae0c04102e53b33b" member_type: VOTER last_known_addr { host: "127.19.29.253" port: 44561 } } peers { permanent_uuid: "3fad084163394f089c3b3ee487583ba1" member_type: VOTER last_known_addr { host: "127.19.29.252" port: 43087 } } }
I20260810 14:53:01.478215 25409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6125e1529a74e8eae5f50d118d96a33 [sys.catalog]: This master's current role is: LEADER
I20260810 14:53:01.617936 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:01.615893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36236 (local address 127.19.29.253:44561)
0810 14:53:01.615971 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.615973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.615985 (+ 12us) server_negotiation.cc:407] Connection header received
0810 14:53:01.616048 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.616049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.616059 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.616107 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:01.616227 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.616697 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.617395 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:01.617566 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:01.617607 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:01.617741 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:01.617765 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:01.617796 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:01.617837 (+ 41us) server_negotiation.cc:299] Negotiation successful
0810 14:53:01.617850 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
W20260810 14:53:01.620172 25351 negotiation.cc:337] Failed RPC negotiation. Trace:
0810 14:53:01.619676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55972 (local address 127.19.29.252:43087)
0810 14:53:01.619726 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:01.619728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:01.619735 (+ 7us) server_negotiation.cc:407] Connection header received
0810 14:53:01.619785 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:01.619786 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:01.619795 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:01.619840 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0810 14:53:01.620110 (+ 270us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55972: BlockingRecv error: recv got EOF from 127.0.0.1:55972 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
I20260810 14:53:01.930766 25376 catalog_manager.cc:1259] Loaded cluster ID: 62a927411eb3471d82593ed736191bed
I20260810 14:53:01.930837 25376 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: loading cluster ID for follower catalog manager: success
I20260810 14:53:01.931615 25376 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: acquiring CA information for follower catalog manager: success
I20260810 14:53:01.931906 25376 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3fad084163394f089c3b3ee487583ba1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260810 14:53:02.135340 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:02.133197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36242 (local address 127.19.29.253:44561)
0810 14:53:02.133313 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:02.133315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:02.133361 (+ 46us) server_negotiation.cc:407] Connection header received
0810 14:53:02.133415 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:02.133416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:02.133428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:02.133515 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:02.133606 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.134115 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.134823 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.135010 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.135056 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:02.135146 (+ 90us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:02.135173 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:02.135205 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:02.135242 (+ 37us) server_negotiation.cc:299] Negotiation successful
0810 14:53:02.135257 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
I20260810 14:53:02.139328 25652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:02.137028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55984 (local address 127.19.29.252:43087)
0810 14:53:02.137156 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:02.137158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:02.137166 (+ 8us) server_negotiation.cc:407] Connection header received
0810 14:53:02.137195 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:02.137195 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:02.137247 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:02.137312 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:02.137442 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.137941 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.138661 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.138855 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.138905 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:02.139054 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:02.139164 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:02.139218 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:02.139232 (+ 14us) server_negotiation.cc:299] Negotiation successful
0810 14:53:02.139249 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260810 14:53:02.143584 25652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:02.140882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55992 (local address 127.19.29.252:43087)
0810 14:53:02.140914 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:02.140916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:02.141037 (+ 121us) server_negotiation.cc:407] Connection header received
0810 14:53:02.141082 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:02.141083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:02.141093 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:02.141139 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:02.141296 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.141748 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.142642 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.142915 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.142968 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:02.143368 (+ 400us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:02.143399 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:02.143444 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:02.143495 (+ 51us) server_negotiation.cc:299] Negotiation successful
0810 14:53:02.143515 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260810 14:53:02.143589 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:02.140775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36250 (local address 127.19.29.253:44561)
0810 14:53:02.140813 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:02.140815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:02.141050 (+ 235us) server_negotiation.cc:407] Connection header received
0810 14:53:02.141146 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:02.141147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:02.141158 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:02.141185 (+ 27us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:02.141345 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.142030 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.142963 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.143152 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.143212 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:02.143335 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:02.143362 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:02.143404 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:02.143491 (+ 87us) server_negotiation.cc:299] Negotiation successful
0810 14:53:02.143516 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260810 14:53:02.143822 25660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0810 14:53:02.140808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53698 (local address 127.19.29.254:45655)
0810 14:53:02.140922 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0810 14:53:02.140923 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0810 14:53:02.140932 (+ 9us) server_negotiation.cc:407] Connection header received
0810 14:53:02.140985 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0810 14:53:02.140986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0810 14:53:02.141041 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0810 14:53:02.141116 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0810 14:53:02.141207 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.141958 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.142919 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0810 14:53:02.143147 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0810 14:53:02.143201 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0810 14:53:02.143405 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0810 14:53:02.143515 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0810 14:53:02.143566 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0810 14:53:02.143720 (+ 154us) server_negotiation.cc:299] Negotiation successful
0810 14:53:02.143748 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":60,"threads_started":1}
I20260810 14:53:02.145488 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25013
I20260810 14:53:02.158329 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25128
I20260810 14:53:02.168757 19575 external_mini_cluster.cc:1595] Killing /tmp/dist-test-tasko2eqSt/build/release/bin/kudu with pid 25244
2026-08-10T14:53:02Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2965 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5887 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (272039 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST